System

Abstract

A system is provided.SOLUTION: A system comprising: means for optimizing a driving route for a truck driver; means for obtaining and analyzing health data; means for providing mental support; means for suggesting an economical and healthy diet; means for real-time communication with a user; and means for providing telemedicine support.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The logistics industry faces challenges such as overwork, health problems, and loneliness among truck drivers. These issues are contributing to reduced work efficiency and safety. With the current worsening driver shortage, improving the working environment is an urgent priority. Conventional technologies are unable to individually optimize drivers' routes, manage their health, and provide mental support, creating a need for an integrated support system. [Means for solving the problem]

[0005] This invention provides a system that provides an integrated system for optimizing driving routes, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. Specifically, the system includes a means for optimizing driving routes for truck drivers, a means for acquiring and analyzing health data, a means for providing mental support, a means for suggesting economical and healthy meals, a means for real-time communication with users, and a means for providing remote medical support. This system significantly improves the working environment for truck drivers, leading to increased efficiency, safety, and health.

[0006] The "route optimization means" is a means for calculating and presenting the optimal route from the user's departure point to the destination using real-time traffic information and map data.

[0007] A "health data acquisition means" is a means for periodically acquiring health-related data such as heart rate, number of steps, and sleep patterns from a sensor device (e.g., a smart watch) worn by a user and storing or transmitting the data.

[0008] The "data transmission means" is a means for transmitting the acquired health data and the data input by the user to the server.

[0009] The "data analysis means" is a means for analyzing the data received by the server and evaluating the health and psychological state of the user.

[0010] The "alert generation means" is a means for generating an alert to notify the user when abnormal values ​​or health risks are detected as a result of analyzing health data.

[0011] "Mental support means" refers to means for evaluating the user's psychological state and providing appropriate advice and support.

[0012] The "question display means" is a means for periodically displaying questions to the user to evaluate the psychological state.

[0013] The "means for suggesting economical and healthy meals" is a means for collecting information on nearby restaurants based on the user's current location information and presenting healthy and economical meal options.

[0014] "Real-time communication means" refers to a means for realizing real-time dialogue with a user through speech recognition and text analysis functions.

[0015] The "telemedical support means" is a means for assigning a medical expert based on a user's request and providing a diagnosis and advice in real time.

[0016] "Video calling means" means a means for a user to have a real-time video call with a medical professional or support staff member.

[0017] The "text analysis means" is a means for analyzing text data entered by a user, understanding its contents, and generating an appropriate response. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] This invention is an integrated AI concierge application system to contribute to improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[0040] Route optimization

[0041] The device obtains the user's current location from the GPS module and prompts the user to input their starting and destination information. This information is sent to the server, which uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[0042] health care

[0043] The device periodically acquires health data such as heart rate, number of steps, and sleep patterns from the sensor device and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[0044] Mental support

[0045] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[0046] Economical meal suggestions

[0047] When a user wants to eat, they input their request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants and searches for prices, menus, and health-conscious options. The server generates optimal meal options and sends them to the device. The user reviews the proposed options and selects one.

[0048] Real-time communication

[0049] The user inputs information by voice or text, which the device recognizes and sends to the server. The server analyzes the input and generates an appropriate response. The generated response is sent to the device and displayed or played aloud to the user. This allows the user to use the concierge function to obtain appropriate information and support in real time.

[0050] Telemedicine Support

[0051] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function, allowing the user and the medical professional to communicate directly. This process allows the user to receive prompt and accurate medical support.

[0052] Specific examples

[0053] For example, when a truck driver departs from a warehouse in a city to head to a distant delivery destination, he or she inputs the destination into the device before setting off. The server calculates the optimal route in real time and displays it on the device. While driving, the device regularly monitors the driver's heart rate and number of steps, and if an abnormality is detected, the server generates an alert and notifies the user. Furthermore, when the driver wants to eat during a delivery, the driver sends a request from the device, and the server searches for nearby restaurants and suggests the best meal options. Furthermore, if the driver feels tired or stressed after a long drive, they can use the device's conversation function to receive mental support.

[0054] In this way, the present invention provides a system that can comprehensively support the working environment and health of truck drivers and improve their efficiency and safety.

[0055] The processing flow will be explained below.

[0056] Route optimization

[0057] Step 1:

[0058] The device obtains the user's current location from the GPS module.

[0059] Step 2:

[0060] The terminal prompts the user to input the starting point and destination, which are then transmitted to the server.

[0061] Step 3:

[0062] The server obtains real-time traffic information via a communication network.

[0063] Step 4:

[0064] The server uses the acquired traffic information and map data to calculate the optimal route.

[0065] Step 5:

[0066] The server transmits the calculated route information to the terminal.

[0067] Step 6:

[0068] The terminal displays the received route information to the user and starts voice navigation.

[0069] Step 7:

[0070] The user follows the instructions on the terminal and starts driving along the route.

[0071] health care

[0072] Step 1:

[0073] The device periodically collects the user's health data (heart rate, number of steps, sleep patterns, etc.) from the sensor device.

[0074] Step 2:

[0075] The device transmits the acquired health data to a server.

[0076] Step 3:

[0077] The server analyzes the received health data and evaluates the user's health condition.

[0078] Step 4:

[0079] If the server detects an anomaly, it generates an alert.

[0080] Step 5:

[0081] The server sends the generated alert to the terminal.

[0082] Step 6:

[0083] The terminal receives the alert and notifies the user.

[0084] Step 7:

[0085] The user checks the notification and takes the necessary action.

[0086] Mental support

[0087] Step 1:

[0088] The terminal periodically displays questions to the user to assess their psychological state.

[0089] Step 2:

[0090] The user answers the questions and enters the answers into the terminal.

[0091] Step 3:

[0092] The terminal transmits the user's answer to the server.

[0093] Step 4:

[0094] The server analyzes the user's response data and evaluates their mental state.

[0095] Step 5:

[0096] The server generates appropriate advice based on the analysis results.

[0097] Step 6:

[0098] The server transmits the generated advice to the terminal.

[0099] Step 7:

[0100] The terminal displays the advice to the user and provides instructions.

[0101] Step 8:

[0102] The user confirms and implements the advice.

[0103] Economical meal suggestions

[0104] Step 1:

[0105] The user inputs a request into the terminal when they want to eat.

[0106] Step 2:

[0107] The terminal obtains the user's current location and transmits it to the server.

[0108] Step 3:

[0109] The server collects information about nearby restaurants based on the current location information.

[0110] Step 4:

[0111] The server analyzes the collected restaurant menus, prices, and health options.

[0112] Step 5:

[0113] The server generates optimal meal options and sends them to the device.

[0114] Step 6:

[0115] The terminal displays suggested restaurants and menus to the user.

[0116] Step 7:

[0117] The user selects and visits the suggested restaurant.

[0118] Real-time communication

[0119] Step 1:

[0120] The user inputs information into the terminal by voice or text.

[0121] Step 2:

[0122] The terminal recognizes the input and sends it to the server.

[0123] Step 3:

[0124] The server parses the input and generates an appropriate response.

[0125] Step 4:

[0126] The server generates a response and sends it to the terminal.

[0127] Step 5:

[0128] The terminal displays or plays the response aloud to the user.

[0129] Step 6:

[0130] Users can obtain information while enjoying interacting with the terminal.

[0131] Telemedicine Support

[0132] Step 1:

[0133] When a user feels unwell, the user inputs a request for remote medical services from the terminal.

[0134] Step 2:

[0135] The terminal sends a request to the server.

[0136] Step 3:

[0137] The server receives the request and assigns the appropriate medical professional.

[0138] Step 4:

[0139] The server establishes a connection with the medical professional and notifies the terminal.

[0140] Step 5:

[0141] The device provides real-time video calling or chat functionality to facilitate communication between users and medical professionals.

[0142] Step 6:

[0143] A medical professional will review the user's symptoms and provide a diagnosis and advice.

[0144] Step 7:

[0145] The device displays the medical professional's diagnosis and advice to the user.

[0146] Step 8:

[0147] The user takes action according to the advice provided.

[0148] Example 1

[0149] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0150] Truck drivers often drive long hours and work in harsh environments. This requires efficient and safe routes, health management and mental support, a balanced diet, and prompt medical support. However, no system has previously existed that provides all of these services in an integrated manner. As a result, drivers are often exposed to the risk of overwork, stress, unhealthy eating, and delays and accidents due to inappropriate driving routes. A comprehensive system to solve these issues is needed.

[0151] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0152] In this invention, the server includes means for acquiring a current location, means for inputting and transmitting start and destination information, means for calculating an optimal driving route using real-time traffic information and map data, means for periodically acquiring and transmitting health data, means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected, means for displaying questions to assess a driver's mental state, acquiring and transmitting answers, means for analyzing the answers to evaluate the driver's mental state and generating appropriate advice, means for inputting a meal request and acquiring current location information, means for collecting information on nearby restaurants and searching for prices, menus, and health-conscious options, means for recognizing and analyzing voice or text input, means for requesting remote medical services and assigning an appropriate medical professional, and means for connecting with the medical professional and providing a video call or chat function. This allows drivers to receive multiple necessary services, such as efficient driving routes, health management, mental support, provision of balanced meals, and prompt remote medical support, all in one place.

[0153] The "means for acquiring the current location" is a device including a GPS module and a sensor device used to acquire the user's location information.

[0154] The "means for inputting and transmitting information on the starting point and destination" refers to an interface and communication means for the user to input the starting point and destination and transmit that information to the server.

[0155] "Means for calculating optimal driving routes using real-time traffic information and map data" refers to a system that includes an algorithm and database for obtaining traffic conditions and map data in real time and calculating optimal driving routes based on that information.

[0156] The "means for periodically acquiring and transmitting health data" is a device that includes communication means for periodically acquiring a user's health data from a sensor device and transmitting that data to a server.

[0157] The "means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected" refers to software and algorithms that allow the server to analyze the user's health data received and generate and notify an alert if an abnormality is detected.

[0158] The "means for displaying questions to evaluate the psychological state and acquiring and transmitting answers" refers to an interface and communication means for displaying questions to evaluate the user's psychological state on a terminal, acquiring the user's answers, and transmitting them to a server.

[0159] The "means for analyzing the answers, assessing the mental state, and generating appropriate advice" refers to software and algorithms that allow the server to analyze the user's answers, assess the mental state, and generate appropriate advice based on the results.

[0160] The "means for inputting a meal request and obtaining current location information" is a device that includes an interface and a GPS module for a user to input a meal request and obtain current location information at that time.

[0161] "Means for collecting information about nearby restaurants and searching for prices, menus, and health-conscious options" refers to software and a database for collecting information about nearby restaurants based on the user's current location information and searching for prices, menus, and health-conscious options.

[0162] "Means for recognizing and analyzing voice or text input" refers to language processing algorithms and software for recognizing a user's voice or text input and analyzing its content.

[0163] "Means for requesting telehealth services and assigning appropriate medical professionals" refers to systems and software for accepting a user's request for telehealth services and selecting and assigning an appropriate medical professional based on the request.

[0164] "Means for connecting with medical professionals and providing video call or chat functionality" refers to an interface and communication means for users and medical professionals to communicate in real time via video call or chat.

[0165] This invention is an integrated AI concierge application system for comprehensively improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[0166] Route optimization

[0167] The device uses a GPS module to obtain the user's current location and prompts the user to input their starting and destination information. This information is sent to a server, which uses real-time traffic information and map data to calculate the optimal route. The results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[0168] As a concrete example, if a user inputs starting point A and destination B, the server will use real-time traffic information and map data (e.g., Google Maps API) to calculate the optimal route and display a notification on the device such as "Highway Route 1 is the shortest."

[0169] Example prompt sentence:

[0170] "Calculate the best route from point A to point B."

[0171] health care

[0172] The device periodically acquires health data such as heart rate, step count, and sleep patterns from a sensor device (e.g., Fitbit) and sends it to a server. The server analyzes the received health data and evaluates the user's health status. If an abnormality is detected, the server generates an alert and notifies the user via the device.

[0173] As a specific example, if a user's heart rate shows abnormalities, the server generates an alert such as "Your heart rate is dropping. Please consult a medical institution" and notifies the device.

[0174] Example prompt sentence:

[0175] "Generate a notification message if an abnormal heart rate is detected."

[0176] Mental support

[0177] The device periodically asks the user questions to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device.

[0178] For example, if a user types, "I've been feeling tired lately. What should I do?", the server will respond with advice such as, "Try taking some deep breaths to relax."

[0179] Example prompt sentence:

[0180] "Please suggest ways for users who have been feeling tired recently to relax."

[0181] Economical meal suggestions

[0182] When a user wants to eat, they input their request into their device, which then acquires their current location. The server uses this location information to gather information about nearby restaurants, searching for prices, menus, and health-conscious options. The best meal options are then sent to the device and displayed to the user.

[0183] For example, if a user types, "Tell me where I can get a cheap, healthy meal nearby," the server will notify the device of the result, such as, "XYZ Restaurant, salads for 550 yen."

[0184] Example prompt sentence:

[0185] "Suggest economical and healthy food options near the user's current location."

[0186] Real-time communication

[0187] The user provides input via voice or text, which the device recognizes and sends to the server, which analyzes the input and generates an appropriate response, which is then sent to the device and displayed or played aloud to the user.

[0188] As a specific example, if a user voice-inputs "What's the weather going to be like tomorrow?", the server retrieves information from a weather forecast service (e.g., the OpenWeather API) and generates a response such as "It's going to be sunny tomorrow."

[0189] Example prompt sentence:

[0190] "Please tell me the weather forecast for tomorrow."

[0191] Telemedicine Support

[0192] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established with the medical professional, the device provides real-time video calls or chat functionality, allowing the user and the medical professional to communicate directly.

[0193] For example, if a user inputs "I have a persistent headache and would like to speak to a doctor," the server will assign a medical professional and start a video call. The medical professional will communicate with the user by asking them to explain their symptoms in detail.

[0194] Example prompt sentence:

[0195] "Generate initial diagnostic questions for users suffering from headaches."

[0196] In this way, the integrated AI concierge application system of the present invention is a system that can comprehensively support the working environment and health of truck drivers, and improve efficiency and safety.

[0197] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0198] Route optimization

[0199] Step 1:

[0200] The terminal uses a GPS module to obtain the user's current location.

[0201] Input: Location information from GPS module

[0202] Output: Current location (e.g., latitude 34.0522, longitude -118.2437)

[0203] Specific behavior:

[0204] The device obtains its current location information of "latitude 34.0522, longitude -118.2437".

[0205] Step 2:

[0206] The user inputs the departure point and destination information into the terminal.

[0207] Input: Departure point and destination information (e.g., point A and point B)

[0208] Output: User input data

[0209] Specific behavior:

[0210] The user inputs "starting point A" and "destination B" into the terminal.

[0211] Step 3:

[0212] The terminal transmits the acquired current location, departure point, and destination information to the server.

[0213] Input: current location, starting point, destination information

[0214] Output: Data sent to the server

[0215] Specific behavior:

[0216] The device sends the data "starting point A, destination B, current location (latitude 34.0522, longitude -118.2437)" to the server.

[0217] Step 4:

[0218] The server uses real-time traffic information and map data to calculate the optimal route.

[0219] Input: Data sent to the server, traffic information, map data

[0220] Output: Optimal route

[0221] Specific behavior:

[0222] The server uses the Google Maps API to request the "shortest route from starting point A to destination B" and calculates the optimal route.

[0223] Step 5:

[0224] The server sends the calculation results to the terminal, which displays the results to the user.

[0225] Input: Optimal route

[0226] Output: Data displayed to the user

[0227] Specific behavior:

[0228] The server sends route information to the terminal stating, "Route 1 using the expressway is the shortest route."

[0229] The device displays the route on the screen and provides voice guidance.

[0230] health care

[0231] Step 1:

[0232] The device periodically collects health data such as heart rate, steps taken, and sleep patterns from sensor devices.

[0233] Input: Health data from sensor devices

[0234] Output: Retrieved health data

[0235] Specific behavior:

[0236] The device receives the following data from Fitbit: Heart rate: 72 bpm, Steps: 3000, Sleep time: 7 hours.

[0237] Step 2:

[0238] The device transmits the acquired health data to a server.

[0239] Input: Acquired health data

[0240] Output: Data sent to the server

[0241] Specific behavior:

[0242] The device sends the following data to the server: heart rate: 72 bpm, steps: 3000, sleep time: 7 hours.

[0243] Step 3:

[0244] The server analyzes the received health data and evaluates the user's health condition.

[0245] Input: Health data sent to the server

[0246] Output: Health status assessment results

[0247] Specific behavior:

[0248] The server analyzes the received data and evaluates it as follows: "A heart rate of 72 bpm is normal, 3,000 steps is half the recommended number, and 7 hours of sleep is sufficient."

[0249] Step 4:

[0250] If an abnormality is detected, the server generates an alert and notifies the user via their terminal.

[0251] Input: Health status assessment results

[0252] Output: Alert

[0253] Specific behavior:

[0254] The server generates an alert saying, "Your step count is low, so walk more," and sends it to the device.

[0255] The device will display an alert to the user and notify them via audio.

[0256] Mental support

[0257] Step 1:

[0258] The terminal periodically displays questions to the user to assess their psychological state and obtains the user's answers.

[0259] Input: User's answer

[0260] Output: The answer obtained

[0261] Specific behavior:

[0262] The device displays the question "Have you been feeling stressed lately?" and the user answers "Yes."

[0263] Step 2:

[0264] The terminal transmits the user's answer to the server.

[0265] Input: The answer obtained

[0266] Output: The answer sent to the server

[0267] Specific behavior:

[0268] The terminal sends the answer "yes" to the server.

[0269] Step 3:

[0270] The server analyzes the answers and evaluates the user's mental state.

[0271] Input: The answer sent to the server

[0272] Output: Mental state evaluation results

[0273] Specific behavior:

[0274] The server analyzes the responses and assesses that "stress may be increasing."

[0275] Step 4:

[0276] The server generates appropriate advice based on the analysis results and provides it to the user via the terminal.

[0277] Input: Mental state assessment results

[0278] Output: Generated advice

[0279] Specific behavior:

[0280] The server generates advice such as "Try deep breathing to relax" and sends it to the terminal.

[0281] The terminal displays the advice to the user and provides voice guidance.

[0282] Economical meal suggestions

[0283] Step 1:

[0284] When the user wants to eat, they input a request into the terminal, and the terminal acquires their current location.

[0285] Input: Meal request, current location information

[0286] Output: Retrieved request and location information

[0287] Specific behavior:

[0288] A user requests, "Tell me where I can get a cheap, healthy meal nearby."

[0289] The device obtains location information from GPS as "latitude 34.0522, longitude -118.2437".

[0290] Step 2:

[0291] The server collects information about nearby restaurants based on the current location information.

[0292] Input: Current location information

[0293] Output: Collected restaurant information

[0294] Specific behavior:

[0295] The server calls the Yelp API and collects restaurant information based on the location information "latitude 34.0522, longitude -118.2437".

[0296] Step 3:

[0297] The server uses the collected information to search for prices, menus, and health-conscious options.

[0298] Input: Collected restaurant information

[0299] Output: Best meal options

[0300] Specific behavior:

[0301] The server analyzes the data and selects healthy options such as "XYZ restaurant, salad for 550 yen."

[0302] Step 4:

[0303] The server sends the results to the terminal, which displays the information to the user.

[0304] Enter: Best Meal Options

[0305] Output: Data displayed to the user

[0306] Specific behavior:

[0307] The server sends the optimal option, "XYZ Restaurant, salad for 550 yen," to the terminal.

[0308] The device displays this to the user and notifies them with a voice message saying, "We recommend the nearby XYZ restaurant."

[0309] Real-time communication

[0310] Step 1:

[0311] The user inputs data by voice or text, which the device recognizes and sends to the server.

[0312] Input: User voice or text input

[0313] Output: Recognized text data

[0314] Specific behavior:

[0315] The user speaks, "Tell me what the weather will be like tomorrow."

[0316] The device converts the voice into text and sends it to the server.

[0317] Step 2:

[0318] The server parses the input and generates an appropriate response.

[0319] Input: Recognized text data

[0320] Output: The generated response

[0321] Specific behavior:

[0322] The server analyzes "What's the weather like tomorrow?"

[0323] Obtain data such as "It will be sunny tomorrow" from a weather forecast service (e.g., OpenWeather API).

[0324] Step 3:

[0325] The server sends the response to the terminal, which displays or plays it aloud to the user.

[0326] Input: Generated response

[0327] Output: Data displayed or played back to the user

[0328] Specific behavior:

[0329] The server responds by sending the message "It will be sunny tomorrow" to the terminal.

[0330] The device will display this and play a voice saying "Tomorrow will be sunny."

[0331] Telemedicine Support

[0332] Step 1:

[0333] When a user feels unwell, they request a remote medical service via their terminal.

[0334] Input: Telehealth service request

[0335] Output: Request data to the server

[0336] Specific behavior:

[0337] The user enters a request saying, "I'm not feeling well and would like to talk to a doctor."

[0338] The device sends a request to the server.

[0339] Step 2:

[0340] The server receives the request and assigns the appropriate medical professional.

[0341] Input: Request data, medical professional database

[0342] Output: Assigned medical professional

[0343] Specific behavior:

[0344] The server selects and assigns the most suitable medical professional from a doctor database.

[0345] Step 3:

[0346] The server establishes a connection with a medical professional and the terminal provides the user with video calling or chat functionality.

[0347] Input: Assigned medical professional, connection request

[0348] Output: Establishing a connection, calling and chatting with the user

[0349] Specific behavior:

[0350] The server establishes a connection with the medical professional and notifies the device.

[0351] The device will prompt the user to "Start a call with your doctor" and begin the video call or chat.

[0352] (Application example 1)

[0353] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0354] Truck drivers and logistics center staff work in harsh environments, and are required to perform their work safely and efficiently while managing their health. However, there is no system that comprehensively supports these tasks. Therefore, the challenge is to provide a system that integrates route optimization, health management, mental support, economical and healthy meal suggestions, real-time communication, and remote medical support.

[0355] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0356] In this invention, the server includes means for optimizing driving routes for truck drivers, means for acquiring and analyzing health data, means for providing mental support, means for suggesting economical and healthy meals, means for real-time communication with users, means for providing remote medical support, means for calculating and displaying optimal delivery routes within a logistics center, means for continuously transmitting health monitoring data to the server and generating alerts when an abnormality is detected, means for evaluating mental states and providing appropriate advice, means for collecting information on nearby restaurants and presenting economical and healthy meal options, and means for acquiring health data using wearable devices, thereby enabling comprehensive support for the working environment of truck drivers and logistics center staff and improving efficiency and safety.

[0357] "Route optimization means" is a method that uses real-time traffic information and map data to calculate and present routes so that trucks and logistics center vehicles can reach their destinations via the most optimal route.

[0358] The "health data acquisition means" is a means for periodically acquiring health data such as heart rate, number of steps, and sleep patterns from the sensor device and transmitting the data to the server.

[0359] The "mental support providing means" is a means for assessing the user's mental state, asking questions to provide appropriate advice and support, and analyzing the answers.

[0360] The "means for suggesting economical and healthy meals" is a means for collecting information on nearby restaurants based on the user's location and presenting economical and healthy meal options based on prices and menu contents.

[0361] "Means for real-time communication with users" refers to means for receiving and analyzing information input by users via voice or text, generating appropriate responses, and presenting them to the users.

[0362] A "telemedical support means" is a means that provides a real-time video call or chat function with a medical professional when a user feels unwell.

[0363] The "means for calculating and displaying the optimum delivery route within a logistics center" is a means for calculating and displaying the optimum route for movement within and around a logistics center.

[0364] "Means for continuously transmitting health monitoring data to a server and generating an alert when an abnormality is detected" refers to means for continuously transmitting health data collected from a wearable device to a server and generating an alert when an abnormality is detected.

[0365] The "means for evaluating a mental state and providing appropriate advice" is a means for presenting a user with questions for evaluating the user's mental state, analyzing the answers to the questions, and providing appropriate advice.

[0366] "Means for collecting information on nearby restaurants and presenting economical and healthy meal options" refers to means for collecting information on restaurants near the user's current location and suggesting economical and nutritionally balanced meals.

[0367] "Means for acquiring health data using a wearable device" refers to means for acquiring health data from a wearable device worn by a user.

[0368] The present invention is an integrated system for comprehensively supporting the working environment of truck drivers and staff in logistics centers. This system includes the following means.

[0369] Route optimization

[0370] The server receives departure and destination information from the device. The device uses a GPS module to obtain the user's current location. The server uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent back to the device and presented to the user visually and audibly, allowing the user to travel efficiently and safely.

[0371] health care

[0372] Wearable devices are used to collect health data such as heart rate, number of steps, and sleep patterns. The collected data is continuously sent to a server via the device. The server analyzes the received health data and generates an alert if an abnormality is detected, notifying the user via the device. This allows users to understand their own health condition in real time and take necessary measures.

[0373] Mental support

[0374] The device periodically displays questions to the user to assess their mental state. The user's answers are sent to a server, which analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive mental health care on a daily basis.

[0375] Economical and healthy meal suggestions

[0376] When a user wants to eat, they input a request into their device. The device obtains their current location and sends it to the server. The server uses the current location information to collect information about nearby restaurants and searches for prices, menus, and health options. The optimal meal options are generated and sent to the device. This allows users to easily choose economical and healthy meals.

[0377] Real-time communication

[0378] The device receives user input via voice or text and sends it to the server. The server analyzes the input, generates an appropriate response, and sends it to the device. The device then displays or plays the response to the user, allowing the user to receive the information or support they need in real time.

[0379] Telemedicine Support

[0380] When a user feels unwell, they request telemedicine services via their device. The request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established, the device provides real-time video calls or chat functionality, allowing the user and medical professional to communicate directly.

[0381] Examples:

[0382] For example, if a staff member at a logistics center wants to use the system to optimize a delivery route, they input the departure and destination into a terminal. The server calculates the optimal route in real time and displays it on the terminal. Staff can check the route information visually and audibly, allowing them to carry out delivery work efficiently. If any abnormalities in the staff's health are detected along the way, an alert will be displayed on the terminal and instructions on how to deal with the situation will be given. The system also supports staff health management by collecting information on nearby restaurants and suggesting healthy meal options.

[0383] Example prompt sentence:

[0384] "Health data monitoring involves periodically collecting the following health information: heart rate, steps taken, and sleep duration. Based on this information, generate an application code that will alert the user if there is an abnormality and provide necessary action or connection to a medical institution."

[0385] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0386] Step 1:

[0387] The device receives the departure point and destination information from the user. At this point, the device uses the GPS module to obtain the user's current location. The inputs are the departure point, destination information, and current location data, which are then sent to the server. Upon receiving this, the server uses real-time traffic information and map data to calculate the optimal route based on the input data.

[0388] Step 2:

[0389] The server uses a real-time traffic information API and a map database to calculate the optimal route from the current location to the destination. The calculated route data is sent to the device. The device receives this route data and provides it to the user visually and audibly. The user can use the displayed route information and audio guidance to efficiently reach their destination.

[0390] Step 3:

[0391] The terminal periodically acquires health data such as heart rate, number of steps, and sleep patterns from the wearable device. The acquired health data is continuously sent to the server. When the server receives the data, it analyzes it and checks for any abnormalities. If an abnormality is detected, the server generates an alert and notifies the user via the terminal. This allows the user to become aware of the abnormality early and take appropriate action.

[0392] Step 4:

[0393] The device periodically displays questions to the user to assess their mental state. The user answers the displayed questions, and the answer data is sent to the server. The server analyzes the data and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[0394] Step 5:

[0395] When a user inputs a request into the device when they want to eat, the device obtains their current location and sends it to the server. The server uses the current location information to collect information about nearby restaurants and searches for prices, menu items, and healthy options. The optimal meal options are generated and sent to the device. The user can use the displayed information to select an economical and healthy meal.

[0396] Step 6:

[0397] The device receives voice or text input from the user and sends it to the server. The server analyzes the input and generates an appropriate response. The response is then sent to the device and presented to the user visually or audibly. This allows the user to obtain the information or support they need in real time.

[0398] Step 7:

[0399] When a user feels unwell, they request telemedicine services via their device. The request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established, the device provides real-time video calls or chat functionality, allowing the user and medical professional to communicate directly, resulting in prompt and appropriate medical support.

[0400] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0401] This invention combines an emotion engine that recognizes the user's emotions in an integrated AI concierge application system to contribute to improving the working environment of truck drivers. This system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. In addition, it monitors the user's emotional state in real time and optimizes various support options based on the results.

[0402] Route optimization

[0403] The device obtains the user's current location from the GPS module and prompts the user to input their starting and destination information. This information is sent to the server, which uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[0404] health care

[0405] The device periodically acquires health data such as heart rate, number of steps, and sleep patterns from the sensor device and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[0406] Mental support

[0407] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[0408] Economical meal suggestions

[0409] When a user wants to eat, they input their request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants and searches for prices, menus, and health-conscious options. The server generates optimal meal options and sends them to the device. The user reviews the proposed options and selects one.

[0410] Real-time communication

[0411] The user inputs information by voice or text, which the device recognizes and sends to the server. The server analyzes the input and generates an appropriate response. The generated response is sent to the device and displayed or played aloud to the user. This allows the user to use the concierge function to obtain appropriate information and support in real time.

[0412] Telemedicine Support

[0413] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function, allowing the user and the medical professional to communicate directly. This process allows the user to receive prompt and accurate medical support.

[0414] Emotion engine integration

[0415] The system also integrates an emotion engine to recognize the user's emotional state in real time. The emotion engine analyzes voice and facial expression data to evaluate the user's current emotional state (e.g., stress, joy, anxiety). The emotion engine's data is fed back to each of the other support tools, and their functions are adjusted based on the user's emotional state.

[0416] Specific examples

[0417] For example, if a truck driver is feeling fatigued or stressed during a long drive, the emotion engine will detect this. As a result, the mental support tool will suggest more relaxing advice or a short break. The route optimization tool will calculate and present a less stressful route (e.g., a route with less traffic) to the user. Furthermore, if an abnormality is detected in the health data (e.g., a sudden increase in heart rate), the remote medical support tool will automatically assign a medical professional to quickly diagnose and treat the problem.

[0418] In this way, the present invention provides comprehensive support for the working environment and health of truck drivers, and by optimizing the support content using an emotion engine, it aims to improve efficiency, safety, and health.

[0419] The processing flow will be explained below.

[0420] Route optimization

[0421] Step 1:

[0422] The terminal obtains the user's current location from the GPS module.

[0423] Step 2:

[0424] The terminal prompts the user to input the starting point and destination, which are then transmitted to the server.

[0425] Step 3:

[0426] The server obtains real-time traffic information via a communication network.

[0427] Step 4:

[0428] The server uses the acquired traffic information and map data to calculate the optimal route.

[0429] Step 5:

[0430] The server transmits the calculated route information to the terminal.

[0431] Step 6:

[0432] The terminal displays the received route information to the user and starts voice navigation.

[0433] Step 7:

[0434] The user follows the instructions on the terminal and starts driving along the route.

[0435] health care

[0436] Step 1:

[0437] The device periodically collects the user's health data (heart rate, number of steps, sleep patterns, etc.) from the sensor device.

[0438] Step 2:

[0439] The device transmits the acquired health data to a server.

[0440] Step 3:

[0441] The server analyzes the received health data and evaluates the user's health condition.

[0442] Step 4:

[0443] If the server detects an anomaly, it generates an alert.

[0444] Step 5:

[0445] The server sends the generated alert to the terminal.

[0446] Step 6:

[0447] The terminal receives the alert and notifies the user.

[0448] Step 7:

[0449] The user checks the notification and takes the necessary action.

[0450] Mental support

[0451] Step 1:

[0452] The terminal periodically displays questions to the user to assess their psychological state.

[0453] Step 2:

[0454] The user answers the questions and enters the answers into the terminal.

[0455] Step 3:

[0456] The terminal transmits the user's answer to the server.

[0457] Step 4:

[0458] The server analyzes the user's response data and evaluates their mental state.

[0459] Step 5:

[0460] The server generates appropriate advice based on the analysis results.

[0461] Step 6:

[0462] The server transmits the generated advice to the terminal.

[0463] Step 7:

[0464] The terminal displays the advice to the user and provides instructions.

[0465] Step 8:

[0466] The user confirms and implements the advice.

[0467] Economical meal suggestions

[0468] Step 1:

[0469] The user inputs a request into the terminal when they want to eat.

[0470] Step 2:

[0471] The terminal obtains the user's current location and transmits it to the server.

[0472] Step 3:

[0473] The server collects information about nearby restaurants based on the current location information.

[0474] Step 4:

[0475] The server analyzes the collected restaurant menus, prices, and health options.

[0476] Step 5:

[0477] The server generates optimal meal options and sends them to the device.

[0478] Step 6:

[0479] The terminal displays suggested restaurants and menus to the user.

[0480] Step 7:

[0481] The user selects and visits the suggested restaurant.

[0482] Real-time communication

[0483] Step 1:

[0484] The user inputs information into the terminal by voice or text.

[0485] Step 2:

[0486] The terminal recognizes the input and sends it to the server.

[0487] Step 3:

[0488] The server parses the input and generates an appropriate response.

[0489] Step 4:

[0490] The server generates a response and sends it to the terminal.

[0491] Step 5:

[0492] The terminal displays or plays the response aloud to the user.

[0493] Step 6:

[0494] Users can obtain information while enjoying interacting with the terminal.

[0495] Telemedicine Support

[0496] Step 1:

[0497] When a user feels unwell, the user inputs a request for remote medical services from the terminal.

[0498] Step 2:

[0499] The terminal sends a request to the server.

[0500] Step 3:

[0501] The server receives the request and assigns the appropriate medical professional.

[0502] Step 4:

[0503] The server establishes a connection with the medical professional and notifies the terminal.

[0504] Step 5:

[0505] The device provides real-time video calling or chat functionality to facilitate communication between users and medical professionals.

[0506] Step 6:

[0507] A medical professional will review the user's symptoms and provide a diagnosis and advice.

[0508] Step 7:

[0509] The device displays the medical professional's diagnosis and advice to the user.

[0510] Step 8:

[0511] The user takes action according to the advice provided.

[0512] Emotion engine integration

[0513] Step 1:

[0514] The terminal acquires the user's voice and facial expression data from a camera and microphone.

[0515] Step 2:

[0516] The terminal transmits the acquired data to the server.

[0517] Step 3:

[0518] The server analyzes the voice data and facial expression data to assess the user's emotional state.

[0519] Step 4:

[0520] The server sends feedback to the mental support means and the travel route optimization means based on the emotional state.

[0521] Step 5:

[0522] The server generates advice and a less stressful route according to the user's emotional state.

[0523] Step 6:

[0524] The server transmits the generated content to the terminal.

[0525] Step 7:

[0526] The device displays appropriate advice and routes to the user based on their emotional state.

[0527] Specific examples

[0528] For example, if a truck driver begins to feel tired after a long drive, the emotion engine will detect this emotion and analyze the driver's voice and facial expression data during the drive. As a result, the server will enhance mental support measures, suggesting relaxation advice and short breaks. In addition, the route optimization tool will recalculate a route with better road conditions to reduce stress and notify the user. Furthermore, if an abnormality is detected in the user's health data, the system will respond quickly and enable remote medical support. This will improve the overall health and mental state of truck drivers.

[0529] Example 2

[0530] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0531] Conventional truck driver systems provide separate functions for route optimization, health management, mental support, meal suggestions, real-time communication, and remote medical support, and the functions are not well integrated. In particular, the user's emotional state is not reflected in real time, making it difficult to receive optimal support. Furthermore, data sharing between different devices and platforms is not smooth, creating a need for a system that truck drivers can use effectively.

[0532] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0533] In this invention, the server includes a means for optimizing a driving route, a means for acquiring and analyzing health data, a means for providing mental support, a means for suggesting economical and healthy meals, a means for real-time communication with a user, a means for providing remote medical support, and a means for recognizing the user's emotional state and providing feedback to the other means. This allows truck drivers to receive integrated support in real time that is linked between different functions, enabling optimal support that takes into account the user's emotional state.

[0534] "User" refers to the entity that uses this system, specifically truck drivers.

[0535] "Server" refers to a central control device that manages data, analyzes it, generates responses, and other processes.

[0536] A "terminal" is a device used by a user, such as a smartphone or tablet, that communicates with a server.

[0537] "Route optimization means" refers to a function that calculates the optimal route using real-time traffic information and map data based on the departure point and destination specified by the user.

[0538] "Health data acquisition means" refers to a function that acquires health data such as the user's heart rate, number of steps, and sleep patterns from the sensor device and transmits that data to a server.

[0539] "Mental support means" refers to a function that evaluates the user's psychological state and provides appropriate advice and care.

[0540] "Economical and healthy meal suggestion means" refers to a function that collects information on nearby restaurants based on the user's current location and suggests meal options that take price and health into consideration.

[0541] "Real-time communication means" refers to functionality that allows for the immediate exchange of information between the user and the system, and is done through voice input or text input.

[0542] "Telemedical support means" refers to a function that allows users to remotely access specialists when they are unwell and receive diagnosis and treatment.

[0543] "Emotion engine" refers to a system that analyzes a user's voice data and facial expression data to recognize the user's emotional state in real time.

[0544] This invention combines an emotion engine that recognizes the user's emotions in an integrated AI concierge application system to contribute to improving the working environment of truck drivers. This system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. In addition, it monitors the user's emotional state in real time and optimizes various support options based on the results.

[0545] Route optimization

[0546] The device uses a GPS module to obtain the user's current location and prompts the user to input starting and destination information. This information is sent to a server, which uses real-time traffic information and map data (e.g., Google Maps API) to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing the user to confirm route information both visually and audibly.

[0547] health care

[0548] The device periodically obtains health data such as heart rate, number of steps, and sleep patterns from sensor devices (e.g., Fitbit, Apple Watch) and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[0549] Mental support

[0550] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers (e.g., Google Cloud NLP API) and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[0551] Economical meal suggestions

[0552] When a user wants to eat, they input a request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants (e.g., Yelp API, Google Places API) and searches for prices, menus, and health-conscious options. The optimal meal options are generated and sent to the device. The user reviews the proposed options and selects one.

[0553] Real-time communication

[0554] The user inputs information via voice or text, which the device recognizes and sends to the server. The server analyzes the input (e.g., Google Cloud NLP API) and generates an appropriate response. The response is then sent to the device and displayed or played aloud to the user. This allows the user to utilize the concierge function to receive appropriate information and support in real time.

[0555] Telemedicine Support

[0556] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function (e.g., Zoom API, Microsoft Teams API) for direct communication between the user and the medical professional. This process allows the user to receive prompt and accurate medical support.

[0557] Emotion engine integration

[0558] The system also integrates an emotion engine to recognize the user's emotional state in real time. The emotion engine analyzes voice and facial expression data to evaluate the user's current emotional state (e.g., stress, joy, anxiety). The emotion engine's data is fed back to each of the other support tools, and their functions are adjusted based on the user's emotional state.

[0559] Specific examples

[0560] For example, if a truck driver is feeling fatigued or stressed during a long drive, the emotion engine will detect this. As a result, the mental support tool will suggest more relaxing advice or a short break. The route optimization tool will calculate and present a less stressful route (e.g., a route with less traffic) to the user. Furthermore, if an abnormality is detected in the health data (e.g., a sudden increase in heart rate), the remote medical support tool will automatically assign a medical professional to quickly diagnose and treat the problem.

[0561] Prompt Sentence Examples

[0562] "Can you please tell me a simple program that evaluates the user's emotional state and optimizes the route accordingly?"

[0563] "Can you give us an example of a program that suggests nearby healthy food options based on the user's current location?"

[0564] "How can we assess a user's emotional state in real time and provide appropriate advice?"

[0565] In this way, the present invention provides comprehensive support for the working environment and health of truck drivers, and by optimizing the support content using an emotion engine, it aims to improve efficiency, safety, and health.

[0566] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0567] Route optimization

[0568] Step 1: User enters start and destination

[0569] The user inputs the starting point and destination information into the terminal, and this data is sent to the server in text format.

[0570] Step 2: The device obtains its current location

[0571] The device uses a built-in GPS module to obtain the user's current location in real time, and this location information (latitude and longitude) is sent to the server.

[0572] Step 3: The device sends the data to the server

[0573] The device transmits the starting point, destination, and current location to the server. The transmitted data includes location information, and the server analyzes the data based on that information.

[0574] Step 4: The server calculates the optimal route

[0575] The server uses the received departure point, destination, and current location information to reference real-time traffic information and map data (e.g., Google Maps API), and calculates the optimal route. The calculation results are generated in JSON format.

[0576] Step 5: The server sends the calculation results to the terminal

[0577] The server then sends the calculated optimal route data to the device, including detailed directions and estimated arrival times.

[0578] Step 6: The device displays the route information to the user.

[0579] The device then displays the received optimal route information to the user, and voice navigation begins along with the visual map display.

[0580] health care

[0581] Step 1: The device acquires data from the sensor device

[0582] The device collects health data such as heart rate, steps, and sleep patterns from sensor devices (e.g., Fitbit, Apple Watch) via Bluetooth or Wi-Fi.

[0583] Step 2: The device sends the health data to the server

[0584] The device periodically transmits the acquired health data, including heart rate, number of steps, and sleep data, to a server.

[0585] Step 3: The server analyzes the data

[0586] The server uses the received health data to analyze it using Python libraries such as Pandas and NumPy, assessing the user's health status and calculating the average and standard deviation.

[0587] Step 4: The server detects an anomaly

[0588] Based on the analysis results, the server generates an alert if an abnormal value exceeding the set threshold is detected.

[0589] Step 5: The device notifies the user of the alert

[0590] The device receives alerts from the server and notifies the user, including advice on how to deal with abnormal health conditions and suggestions for consulting a medical institution.

[0591] Mental support

[0592] Step 1: The device displays questions to assess your emotional state

[0593] The device periodically displays questions to the user to assess their psychological state (e.g., "How are you feeling today?").

[0594] Step 2: User answers questions

[0595] The user inputs answers to the displayed questions, and the input data is sent to the terminal in text format.

[0596] Step 3: The device sends the answer to the server

[0597] The terminal transmits the user's answer data to the server, which includes the question and the corresponding user's answer.

[0598] Step 4: The server parses the answer

[0599] The server analyzes the received answers using text analysis (e.g., Google Cloud NLP API) and evaluates the user's mental state.

[0600] Step 5: Server generates advice

[0601] The server generates appropriate advice based on the analysis results, including methods for relaxation and stress relief. The generated results are output in JSON format.

[0602] Step 6: The device provides advice to the user

[0603] The terminal displays the advice received from the server to the user, using diagrams and text.

[0604] Economical meal suggestions

[0605] Step 1: User enters meal request

[0606] The user inputs a request into the device when they want to eat, and the input data is saved in text format.

[0607] Step 2: The device obtains its current location

[0608] The device uses the built-in GPS module to obtain the user's current location, and the location data is sent to the server in latitude and longitude format.

[0609] Step 3: The device sends a request to the server

[0610] The terminal transmits its current location and a request to the server. The transmitted data includes the user's desired content.

[0611] Step 4: Server collects restaurant information

[0612] The server collects information about nearby restaurants using APIs (e.g., Yelp API, Google Places API). The collected data includes restaurant names, menus, and price information.

[0613] Step 5: The server makes a recommendation based on the criteria.

[0614] The server analyzes the collected data and generates optimal dining options based on price, menu, and health-conscious options, outputting the recommendation results in JSON format.

[0615] Step 6: Your device will display meal options

[0616] The terminal displays the meal options received from the server to the user, who can then review the suggested options and select the meal of their choice.

[0617] Real-time communication

[0618] Step 1: User provides voice or text input

[0619] Users input questions or requests into the device by voice or text, and the voice data is converted into text (e.g., Google Speech-to-Text API).

[0620] Step 2: The device sends the input data to the server

[0621] The device sends voice and text input data to the server, including the user's question.

[0622] Step 3: The server parses the input

[0623] The server parses the received input data (e.g., Google Cloud NLP API) and generates an appropriate response, which is created using a generative AI model.

[0624] Step 4: Server generates response

[0625] The server uses a generative AI model (e.g., OpenAI's GPT-4) to create an appropriate response and outputs it in JSON format.

[0626] Step 5: The device displays or plays a response to the user

[0627] The terminal displays or plays a response received from the server to the user, using text and audio for display.

[0628] Telemedicine Support

[0629] Step 1: User enters telehealth request

[0630] Users input remote medical care requests into the terminal when they feel unwell, and the request data is recorded in text format.

[0631] Step 2: The device sends a request to the server

[0632] The terminal transmits request data to the server, which includes information about the user's poor physical condition.

[0633] Step 3: The server assigns a medical professional

[0634] The server assigns the appropriate medical professional based on the received request, and the assignment result is output in JSON format.

[0635] Step 4: Connect your device to a medical professional

[0636] The device provides real-time video calling or chat functionality for direct communication between users and medical professionals. Video calling uses APIs (e.g., Zoom API, Microsoft Teams API).

[0637] Step 5: Providing medical support

[0638] Medical professionals provide users with diagnoses and treatments, which are communicated to them in real time.

[0639] Emotion engine integration

[0640] Step 1: The device acquires voice and facial expression data

[0641] The device uses a camera and microphone to capture the user's voice and facial expression data, which is collected in real time.

[0642] Step 2: The device sends the data to the server

[0643] The device transmits the acquired voice data and facial expression data to the server. The transmitted data includes voice files and image data.

[0644] Step 3: The server evaluates the emotional state

[0645] The server uses an emotion engine to analyze the voice and facial expression data and evaluate the user's emotional state, outputting the evaluation results in JSON format.

[0646] Step 4: The server feeds the results back to each support function

[0647] The server then provides feedback to each of the other support functions based on the analysis results, adjusting each function based on the user's emotional state. The feedback data includes recommended actions.

[0648] (Application example 2)

[0649] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0650] The logistics industry is required to improve employee operational efficiency while also providing integrated health and mental health care. However, in current systems, these elements exist independently, making it difficult to provide consistent support. Furthermore, there is no adequate system in place to recognize employees' emotional states in real time and provide optimal support based on that information. This results in insufficient improvements to the working environment and adaptive support for individual employees.

[0651] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for optimizing a travel route, a means for acquiring and analyzing health data, a means for providing mental support, a means for suggesting economical and healthy meals, a means for communicating with the user in real time, a means for providing remote medical support, and an emotion engine that recognizes the user's emotions and optimizes various functions. This makes it possible to comprehensively support the working environment and health of logistics industry workers and provide optimal support according to their emotional state.

[0652] The "logistics industry" refers to the industry that systematically transports, stores, and delivers goods.

[0653] "Employee" means a person engaged in a particular job or activity.

[0654] A "route" is a means of transportation or a route from a specific point to a destination.

[0655] "Optimization" refers to achieving the best possible state under specific conditions.

[0656] "Health Data" means information that describes a person's physical health, such as heart rate, number of steps taken, and sleep patterns.

[0657] "Mental support" refers to the provision of psychological advice and assistance.

[0658] "Dietary suggestions" refers to providing information about food to encourage better choices.

[0659] "Real-time communication" refers to the instantaneous exchange of information at the same time.

[0660] "Telehealth support" refers to the provision of medical-related assistance or services from a physically distant location.

[0661] An "emotion engine" is a system or algorithm that analyzes a user's emotional state and responds appropriately based on that information.

[0662] A "server" is a computer system that provides services to clients over a network.

[0663] This invention is an integrated AI concierge application system for logistics industry professionals. The system provides route optimization, health management, mental support, economical and healthy meal suggestions, real-time communication, remote medical support, and various support optimization functions using an emotion engine.

[0664] The server includes the following means:

[0665] 1. Route optimization measures:

[0666] The server calculates the optimal route based on the user's current location obtained from the GPS module and the destination information entered by the user, using real-time traffic information and map data. The results of this calculation are sent to the device and displayed. In addition, voice navigation is provided, allowing the user to confirm route information both visually and audibly.

[0667] 2. Health management measures:

[0668] The server periodically collects and analyzes health data such as heart rate, step count, and sleep patterns from the sensor device. If an abnormality is detected, an alert is generated and notified to the user via the device, allowing the user to take prompt action.

[0669] 3. Mental support measures:

[0670] The server analyzes the user's answers to questions displayed on the device to assess their psychological state. Based on the analysis results, it generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[0671] 4. Economical and healthy meal suggestions:

[0672] The server receives a request from the user when they want to eat, obtains their current location, and then searches for nearby restaurants based on price, menu, and health-conscious options. Based on this information, it generates optimal meal options and sends them to the user.

[0673] 5. Real-time communication methods:

[0674] The server analyzes the user's voice or text input and generates an appropriate response, which is sent to the device and displayed or played aloud to the user, providing instant information or assistance.

[0675] 6. Telemedicine support methods:

[0676] The server allows users to request telemedicine services via their device when they feel unwell. The server then assigns an appropriate medical professional to the user. Once a connection with the medical professional is established, the device provides real-time video calls and chat functions.

[0677] 7. Emotion Engine:

[0678] The server analyzes the voice data and facial expression data to recognize the user's emotional state in real time. The data analyzed by the emotion engine is fed back to each of the other support means, and the support provided is adjusted based on the user's emotional state.

[0679] Specific examples

[0680] For example, if an employee working in a logistics center wearing smart glasses feels fatigued after working for a long time, the emotion engine will detect this and provide mental support, suggesting relaxation advice or a short break, while the route optimization tool will calculate a less stressful route and change work instructions.

[0681] Prompt Sentence Examples

[0682] "We are developing an integrated AI concierge application system for employees working in logistics centers to improve their working environment. The system combines an emotion engine that recognizes the user's emotions and provides the following functions: route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. This system uses smartphones, smart glasses, and head-mounted displays. Please explain in detail how the system processes data and achieves each function."

[0683] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0684] Step 1:

[0685] When a user wants to optimize their route, they input their current location and destination into the device. This information is acquired using a GPS module and sent to the server. The server uses real-time traffic information and map data to calculate the optimal route based on this input and sends the results to the device. The device then displays the calculation results and provides voice navigation.

[0686] Step 2:

[0687] The device collects data from sensor devices so that users can regularly monitor their health data, such as heart rate, steps, and sleep patterns. This data is then sent to a server where it is analyzed. If an abnormal value is detected, the server generates an alert and sends a notification to the user via the device. The user can then take appropriate action based on the alert content.

[0688] Step 3:

[0689] The device periodically displays questions to the user to assess their psychological state. The data the user answers is sent to a server, where natural language analysis is performed. Based on the analysis results, the server generates appropriate mental support advice and sends it to the device. The user can then review this advice and receive mental health care.

[0690] Step 4:

[0691] When a user wants to eat, they input a request into their device. The device obtains their current location information and sends it to the server. The server then collects information about nearby restaurants based on their current location and searches for prices, menus, and health-conscious options. The best meal options are generated and sent back to the device. The user can review this information and make a selection.

[0692] Step 5:

[0693] When a user inputs something using voice or text, the device recognizes it and sends it to the server. The server analyzes the input and generates an appropriate response. The response is then sent to the device and displayed to the user or played aloud, allowing the user to instantly access the information or support they need.

[0694] Step 6:

[0695] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established with the medical professional, the device provides real-time video calls and chat functions, allowing the user to communicate directly with the professional.

[0696] Step 7:

[0697] The device captures voice and facial expression data using a camera and microphone and sends it to a server. The server then uses an emotion recognition algorithm to analyze the user's emotional state and feeds the analysis results back to other devices. The support provided is adjusted based on the emotional data.

[0698] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0699] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0700] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0701] [Second embodiment]

[0702] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0703] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0704] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0705] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0706] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0707] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0708] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0709] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0710] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0711] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0712] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0713] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0714] This invention is an integrated AI concierge application system to contribute to improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[0715] Route optimization

[0716] The device obtains the user's current location from the GPS module and prompts the user to input their starting and destination information. This information is sent to the server, which uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[0717] health care

[0718] The device periodically acquires health data such as heart rate, number of steps, and sleep patterns from the sensor device and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[0719] Mental support

[0720] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[0721] Economical meal suggestions

[0722] When a user wants to eat, they input their request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants and searches for prices, menus, and health-conscious options. The server generates optimal meal options and sends them to the device. The user reviews the proposed options and selects one.

[0723] Real-time communication

[0724] The user inputs information by voice or text, which the device recognizes and sends to the server. The server analyzes the input and generates an appropriate response. The generated response is sent to the device and displayed or played aloud to the user. This allows the user to use the concierge function to obtain appropriate information and support in real time.

[0725] Telemedicine Support

[0726] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function, allowing the user and the medical professional to communicate directly. This process allows the user to receive prompt and accurate medical support.

[0727] Specific examples

[0728] For example, when a truck driver departs from a warehouse in a city to head to a distant delivery destination, he or she inputs the destination into the device before setting off. The server calculates the optimal route in real time and displays it on the device. While driving, the device regularly monitors the driver's heart rate and number of steps, and if an abnormality is detected, the server generates an alert and notifies the user. Furthermore, when the driver wants to eat during a delivery, the driver sends a request from the device, and the server searches for nearby restaurants and suggests the best meal options. Furthermore, if the driver feels tired or stressed after a long drive, they can use the device's conversation function to receive mental support.

[0729] In this way, the present invention provides a system that can comprehensively support the working environment and health of truck drivers and improve their efficiency and safety.

[0730] The processing flow will be explained below.

[0731] Route optimization

[0732] Step 1:

[0733] The device obtains the user's current location from the GPS module.

[0734] Step 2:

[0735] The terminal prompts the user to input the starting point and destination, which are then transmitted to the server.

[0736] Step 3:

[0737] The server obtains real-time traffic information via a communication network.

[0738] Step 4:

[0739] The server uses the acquired traffic information and map data to calculate the optimal route.

[0740] Step 5:

[0741] The server transmits the calculated route information to the terminal.

[0742] Step 6:

[0743] The terminal displays the received route information to the user and starts voice navigation.

[0744] Step 7:

[0745] The user follows the instructions on the terminal and starts driving along the route.

[0746] health care

[0747] Step 1:

[0748] The device periodically collects the user's health data (heart rate, number of steps, sleep patterns, etc.) from the sensor device.

[0749] Step 2:

[0750] The device transmits the acquired health data to a server.

[0751] Step 3:

[0752] The server analyzes the received health data and evaluates the user's health condition.

[0753] Step 4:

[0754] If the server detects an anomaly, it generates an alert.

[0755] Step 5:

[0756] The server sends the generated alert to the terminal.

[0757] Step 6:

[0758] The terminal receives the alert and notifies the user.

[0759] Step 7:

[0760] The user checks the notification and takes the necessary action.

[0761] Mental support

[0762] Step 1:

[0763] The terminal periodically displays questions to the user to assess their psychological state.

[0764] Step 2:

[0765] The user answers the questions and enters the answers into the terminal.

[0766] Step 3:

[0767] The terminal transmits the user's answer to the server.

[0768] Step 4:

[0769] The server analyzes the user's response data and evaluates their mental state.

[0770] Step 5:

[0771] The server generates appropriate advice based on the analysis results.

[0772] Step 6:

[0773] The server transmits the generated advice to the terminal.

[0774] Step 7:

[0775] The terminal displays the advice to the user and provides instructions.

[0776] Step 8:

[0777] The user confirms and implements the advice.

[0778] Economical meal suggestions

[0779] Step 1:

[0780] The user inputs a request into the terminal when they want to eat.

[0781] Step 2:

[0782] The terminal obtains the user's current location and transmits it to the server.

[0783] Step 3:

[0784] The server collects information about nearby restaurants based on the current location information.

[0785] Step 4:

[0786] The server analyzes the collected restaurant menus, prices, and health options.

[0787] Step 5:

[0788] The server generates optimal meal options and sends them to the device.

[0789] Step 6:

[0790] The terminal displays suggested restaurants and menus to the user.

[0791] Step 7:

[0792] The user selects and visits the suggested restaurant.

[0793] Real-time communication

[0794] Step 1:

[0795] The user inputs information into the terminal by voice or text.

[0796] Step 2:

[0797] The terminal recognizes the input and sends it to the server.

[0798] Step 3:

[0799] The server parses the input and generates an appropriate response.

[0800] Step 4:

[0801] The server generates a response and sends it to the terminal.

[0802] Step 5:

[0803] The terminal displays or plays the response aloud to the user.

[0804] Step 6:

[0805] Users can obtain information while enjoying interacting with the terminal.

[0806] Telemedicine Support

[0807] Step 1:

[0808] When a user feels unwell, the user inputs a request for remote medical services from the terminal.

[0809] Step 2:

[0810] The terminal sends a request to the server.

[0811] Step 3:

[0812] The server receives the request and assigns the appropriate medical professional.

[0813] Step 4:

[0814] The server establishes a connection with the medical professional and notifies the terminal.

[0815] Step 5:

[0816] The device provides real-time video calling or chat functionality to facilitate communication between users and medical professionals.

[0817] Step 6:

[0818] A medical professional will review the user's symptoms and provide a diagnosis and advice.

[0819] Step 7:

[0820] The device displays the medical professional's diagnosis and advice to the user.

[0821] Step 8:

[0822] The user takes action according to the advice provided.

[0823] Example 1

[0824] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0825] Truck drivers often drive long hours and work in harsh environments. This requires efficient and safe routes, health management and mental support, a balanced diet, and prompt medical support. However, no system has previously existed that provides all of these services in an integrated manner. As a result, drivers are often exposed to the risk of overwork, stress, unhealthy eating, and delays and accidents due to inappropriate driving routes. A comprehensive system to solve these issues is needed.

[0826] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0827] In this invention, the server includes means for acquiring a current location, means for inputting and transmitting start and destination information, means for calculating an optimal driving route using real-time traffic information and map data, means for periodically acquiring and transmitting health data, means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected, means for displaying questions to assess a driver's mental state, acquiring and transmitting answers, means for analyzing the answers to evaluate the driver's mental state and generating appropriate advice, means for inputting a meal request and acquiring current location information, means for collecting information on nearby restaurants and searching for prices, menus, and health-conscious options, means for recognizing and analyzing voice or text input, means for requesting remote medical services and assigning an appropriate medical professional, and means for connecting with the medical professional and providing a video call or chat function. This allows drivers to receive multiple necessary services, such as efficient driving routes, health management, mental support, provision of balanced meals, and prompt remote medical support, all in one place.

[0828] The "means for acquiring the current location" is a device including a GPS module and a sensor device used to acquire the user's location information.

[0829] The "means for inputting and transmitting information on the starting point and destination" refers to an interface and communication means for the user to input the starting point and destination and transmit that information to the server.

[0830] "Means for calculating optimal driving routes using real-time traffic information and map data" refers to a system that includes an algorithm and database for obtaining traffic conditions and map data in real time and calculating optimal driving routes based on that information.

[0831] The "means for periodically acquiring and transmitting health data" is a device that includes communication means for periodically acquiring a user's health data from a sensor device and transmitting that data to a server.

[0832] The "means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected" refers to software and algorithms that allow the server to analyze the user's health data received and generate and notify an alert if an abnormality is detected.

[0833] The "means for displaying questions to evaluate the psychological state and acquiring and transmitting answers" refers to an interface and communication means for displaying questions to evaluate the user's psychological state on a terminal, acquiring the user's answers, and transmitting them to a server.

[0834] The "means for analyzing the answers, assessing the mental state, and generating appropriate advice" refers to software and algorithms that allow the server to analyze the user's answers, assess the mental state, and generate appropriate advice based on the results.

[0835] The "means for inputting a meal request and obtaining current location information" is a device that includes an interface and a GPS module for a user to input a meal request and obtain current location information at that time.

[0836] "Means for collecting information about nearby restaurants and searching for prices, menus, and health-conscious options" refers to software and a database for collecting information about nearby restaurants based on the user's current location information and searching for prices, menus, and health-conscious options.

[0837] "Means for recognizing and analyzing voice or text input" refers to language processing algorithms and software for recognizing a user's voice or text input and analyzing its content.

[0838] "Means for requesting telehealth services and assigning appropriate medical professionals" refers to systems and software for accepting a user's request for telehealth services and selecting and assigning an appropriate medical professional based on the request.

[0839] "Means for connecting with medical professionals and providing video call or chat functionality" refers to an interface and communication means for users and medical professionals to communicate in real time via video call or chat.

[0840] This invention is an integrated AI concierge application system for comprehensively improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[0841] Route optimization

[0842] The device uses a GPS module to obtain the user's current location and prompts the user to input their starting and destination information. This information is sent to a server, which uses real-time traffic information and map data to calculate the optimal route. The results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[0843] As a concrete example, if a user inputs starting point A and destination B, the server will use real-time traffic information and map data (e.g., Google Maps API) to calculate the optimal route and display a notification on the device such as "Highway Route 1 is the shortest."

[0844] Example prompt sentence:

[0845] "Calculate the best route from point A to point B."

[0846] health care

[0847] The device periodically acquires health data such as heart rate, step count, and sleep patterns from a sensor device (e.g., Fitbit) and sends it to a server. The server analyzes the received health data and evaluates the user's health status. If an abnormality is detected, the server generates an alert and notifies the user via the device.

[0848] As a specific example, if a user's heart rate shows abnormalities, the server generates an alert such as "Your heart rate is dropping. Please consult a medical institution" and notifies the device.

[0849] Example prompt sentence:

[0850] "Generate a notification message if an abnormal heart rate is detected."

[0851] Mental support

[0852] The device periodically asks the user questions to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device.

[0853] For example, if a user types, "I've been feeling tired lately. What should I do?", the server will respond with advice such as, "Try taking some deep breaths to relax."

[0854] Example prompt sentence:

[0855] "Please suggest ways for users who have been feeling tired recently to relax."

[0856] Economical meal suggestions

[0857] When a user wants to eat, they input their request into their device, which then acquires their current location. The server uses this location information to gather information about nearby restaurants, searching for prices, menus, and health-conscious options. The best meal options are then sent to the device and displayed to the user.

[0858] For example, if a user types, "Tell me where I can get a cheap, healthy meal nearby," the server will notify the device of the result, such as, "XYZ Restaurant, salads for 550 yen."

[0859] Example prompt sentence:

[0860] "Suggest economical and healthy food options near the user's current location."

[0861] Real-time communication

[0862] The user provides input via voice or text, which the device recognizes and sends to the server, which analyzes the input and generates an appropriate response, which is then sent to the device and displayed or played aloud to the user.

[0863] As a specific example, if a user voice-inputs "What's the weather going to be like tomorrow?", the server retrieves information from a weather forecast service (e.g., the OpenWeather API) and generates a response such as "It's going to be sunny tomorrow."

[0864] Example prompt sentence:

[0865] "Please tell me the weather forecast for tomorrow."

[0866] Telemedicine Support

[0867] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established with the medical professional, the device provides real-time video calls or chat functionality, allowing the user and the medical professional to communicate directly.

[0868] For example, if a user inputs "I have a persistent headache and would like to speak to a doctor," the server will assign a medical professional and start a video call. The medical professional will communicate with the user by asking them to explain their symptoms in detail.

[0869] Example prompt sentence:

[0870] "Generate initial diagnostic questions for users suffering from headaches."

[0871] In this way, the integrated AI concierge application system of the present invention is a system that can comprehensively support the working environment and health of truck drivers, and improve efficiency and safety.

[0872] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0873] Route optimization

[0874] Step 1:

[0875] The terminal uses a GPS module to obtain the user's current location.

[0876] Input: Location information from GPS module

[0877] Output: Current location (e.g., latitude 34.0522, longitude -118.2437)

[0878] Specific behavior:

[0879] The device obtains its current location information of "latitude 34.0522, longitude -118.2437".

[0880] Step 2:

[0881] The user inputs the departure point and destination information into the terminal.

[0882] Input: Departure point and destination information (e.g., point A and point B)

[0883] Output: User input data

[0884] Specific behavior:

[0885] The user inputs "starting point A" and "destination B" into the terminal.

[0886] Step 3:

[0887] The terminal transmits the acquired current location, departure point, and destination information to the server.

[0888] Input: current location, starting point, destination information

[0889] Output: Data sent to the server

[0890] Specific behavior:

[0891] The device sends the data "starting point A, destination B, current location (latitude 34.0522, longitude -118.2437)" to the server.

[0892] Step 4:

[0893] The server uses real-time traffic information and map data to calculate the optimal route.

[0894] Input: Data sent to the server, traffic information, map data

[0895] Output: Optimal route

[0896] Specific behavior:

[0897] The server uses the Google Maps API to request the "shortest route from starting point A to destination B" and calculates the optimal route.

[0898] Step 5:

[0899] The server sends the calculation results to the terminal, which displays the results to the user.

[0900] Input: Optimal route

[0901] Output: Data displayed to the user

[0902] Specific behavior:

[0903] The server sends route information to the terminal stating, "Route 1 using the expressway is the shortest route."

[0904] The device displays the route on the screen and provides voice guidance.

[0905] health care

[0906] Step 1:

[0907] The device periodically collects health data such as heart rate, steps taken, and sleep patterns from sensor devices.

[0908] Input: Health data from sensor devices

[0909] Output: Retrieved health data

[0910] Specific behavior:

[0911] The device receives the following data from Fitbit: Heart rate: 72 bpm, Steps: 3000, Sleep time: 7 hours.

[0912] Step 2:

[0913] The device transmits the acquired health data to a server.

[0914] Input: Acquired health data

[0915] Output: Data sent to the server

[0916] Specific behavior:

[0917] The device sends the following data to the server: heart rate: 72 bpm, steps: 3000, sleep time: 7 hours.

[0918] Step 3:

[0919] The server analyzes the received health data and evaluates the user's health condition.

[0920] Input: Health data sent to the server

[0921] Output: Health status assessment results

[0922] Specific behavior:

[0923] The server analyzes the received data and evaluates it as follows: "A heart rate of 72 bpm is normal, 3,000 steps is half the recommended number, and 7 hours of sleep is sufficient."

[0924] Step 4:

[0925] If an abnormality is detected, the server generates an alert and notifies the user via their terminal.

[0926] Input: Health status assessment results

[0927] Output: Alert

[0928] Specific behavior:

[0929] The server generates an alert saying, "Your step count is low, so walk more," and sends it to the device.

[0930] The device will display an alert to the user and notify them via audio.

[0931] Mental support

[0932] Step 1:

[0933] The terminal periodically displays questions to the user to assess their psychological state and obtains the user's answers.

[0934] Input: User's answer

[0935] Output: The answer obtained

[0936] Specific behavior:

[0937] The device displays the question "Have you been feeling stressed lately?" and the user answers "Yes."

[0938] Step 2:

[0939] The terminal transmits the user's answer to the server.

[0940] Input: The answer obtained

[0941] Output: The answer sent to the server

[0942] Specific behavior:

[0943] The terminal sends the answer "yes" to the server.

[0944] Step 3:

[0945] The server analyzes the answers and evaluates the user's mental state.

[0946] Input: The answer sent to the server

[0947] Output: Mental state evaluation results

[0948] Specific behavior:

[0949] The server analyzes the responses and assesses that "stress may be increasing."

[0950] Step 4:

[0951] The server generates appropriate advice based on the analysis results and provides it to the user via the terminal.

[0952] Input: Mental state assessment results

[0953] Output: Generated advice

[0954] Specific behavior:

[0955] The server generates advice such as "Try deep breathing to relax" and sends it to the terminal.

[0956] The terminal displays the advice to the user and provides voice guidance.

[0957] Economical meal suggestions

[0958] Step 1:

[0959] When the user wants to eat, they input a request into the terminal, and the terminal acquires their current location.

[0960] Input: Meal request, current location information

[0961] Output: Retrieved request and location information

[0962] Specific behavior:

[0963] A user requests, "Tell me where I can get a cheap, healthy meal nearby."

[0964] The device obtains location information from GPS as "latitude 34.0522, longitude -118.2437".

[0965] Step 2:

[0966] The server collects information about nearby restaurants based on the current location information.

[0967] Input: Current location information

[0968] Output: Collected restaurant information

[0969] Specific behavior:

[0970] The server calls the Yelp API and collects restaurant information based on the location information "latitude 34.0522, longitude -118.2437".

[0971] Step 3:

[0972] The server uses the collected information to search for prices, menus, and health-conscious options.

[0973] Input: Collected restaurant information

[0974] Output: Best meal options

[0975] Specific behavior:

[0976] The server analyzes the data and selects healthy options such as "XYZ restaurant, salad for 550 yen."

[0977] Step 4:

[0978] The server sends the results to the terminal, which displays the information to the user.

[0979] Enter: Best Meal Options

[0980] Output: Data displayed to the user

[0981] Specific behavior:

[0982] The server sends the optimal option, "XYZ Restaurant, salad for 550 yen," to the terminal.

[0983] The device displays this to the user and notifies them with a voice message saying, "We recommend the nearby XYZ restaurant."

[0984] Real-time communication

[0985] Step 1:

[0986] The user inputs data by voice or text, which the device recognizes and sends to the server.

[0987] Input: User voice or text input

[0988] Output: Recognized text data

[0989] Specific behavior:

[0990] The user speaks, "Tell me what the weather will be like tomorrow."

[0991] The device converts the voice into text and sends it to the server.

[0992] Step 2:

[0993] The server parses the input and generates an appropriate response.

[0994] Input: Recognized text data

[0995] Output: The generated response

[0996] Specific behavior:

[0997] The server analyzes "What's the weather like tomorrow?"

[0998] Obtain data such as "It will be sunny tomorrow" from a weather forecast service (e.g., OpenWeather API).

[0999] Step 3:

[1000] The server sends the response to the terminal, which displays or plays it aloud to the user.

[1001] Input: Generated response

[1002] Output: Data displayed or played back to the user

[1003] Specific behavior:

[1004] The server responds by sending the message "It will be sunny tomorrow" to the terminal.

[1005] The device will display this and play a voice saying "Tomorrow will be sunny."

[1006] Telemedicine Support

[1007] Step 1:

[1008] When a user feels unwell, they request a remote medical service via their terminal.

[1009] Input: Telehealth service request

[1010] Output: Request data to the server

[1011] Specific behavior:

[1012] The user enters a request saying, "I'm not feeling well and would like to talk to a doctor."

[1013] The device sends a request to the server.

[1014] Step 2:

[1015] The server receives the request and assigns the appropriate medical professional.

[1016] Input: Request data, medical professional database

[1017] Output: Assigned medical professional

[1018] Specific behavior:

[1019] The server selects and assigns the most suitable medical professional from a doctor database.

[1020] Step 3:

[1021] The server establishes a connection with a medical professional and the terminal provides the user with video calling or chat functionality.

[1022] Input: Assigned medical professional, connection request

[1023] Output: Establishing a connection, calling and chatting with the user

[1024] Specific behavior:

[1025] The server establishes a connection with the medical professional and notifies the device.

[1026] The device will prompt the user to "Start a call with your doctor" and begin the video call or chat.

[1027] (Application example 1)

[1028] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1029] Truck drivers and logistics center staff work in harsh environments, and are required to perform their work safely and efficiently while managing their health. However, there is no system that comprehensively supports these tasks. Therefore, the challenge is to provide a system that integrates route optimization, health management, mental support, economical and healthy meal suggestions, real-time communication, and remote medical support.

[1030] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1031] In this invention, the server includes means for optimizing driving routes for truck drivers, means for acquiring and analyzing health data, means for providing mental support, means for suggesting economical and healthy meals, means for real-time communication with users, means for providing remote medical support, means for calculating and displaying optimal delivery routes within a logistics center, means for continuously transmitting health monitoring data to the server and generating alerts when an abnormality is detected, means for evaluating mental states and providing appropriate advice, means for collecting information on nearby restaurants and presenting economical and healthy meal options, and means for acquiring health data using wearable devices, thereby enabling comprehensive support for the working environment of truck drivers and logistics center staff and improving efficiency and safety.

[1032] "Route optimization means" is a method that uses real-time traffic information and map data to calculate and present routes so that trucks and logistics center vehicles can reach their destinations via the most optimal route.

[1033] The "health data acquisition means" is a means for periodically acquiring health data such as heart rate, number of steps, and sleep patterns from the sensor device and transmitting the data to the server.

[1034] The "mental support providing means" is a means for assessing the user's mental state, asking questions to provide appropriate advice and support, and analyzing the answers.

[1035] The "means for suggesting economical and healthy meals" is a means for collecting information on nearby restaurants based on the user's location and presenting economical and healthy meal options based on prices and menu contents.

[1036] "Means for real-time communication with users" refers to means for receiving and analyzing information input by users via voice or text, generating appropriate responses, and presenting them to the users.

[1037] A "telemedical support means" is a means that provides a real-time video call or chat function with a medical professional when a user feels unwell.

[1038] The "means for calculating and displaying the optimum delivery route within a logistics center" is a means for calculating and displaying the optimum route for movement within and around a logistics center.

[1039] "Means for continuously transmitting health monitoring data to a server and generating an alert when an abnormality is detected" refers to means for continuously transmitting health data collected from a wearable device to a server and generating an alert when an abnormality is detected.

[1040] The "means for evaluating a mental state and providing appropriate advice" is a means for presenting a user with questions for evaluating the user's mental state, analyzing the answers to the questions, and providing appropriate advice.

[1041] "Means for collecting information on nearby restaurants and presenting economical and healthy meal options" refers to means for collecting information on restaurants near the user's current location and suggesting economical and nutritionally balanced meals.

[1042] "Means for acquiring health data using a wearable device" refers to means for acquiring health data from a wearable device worn by a user.

[1043] The present invention is an integrated system for comprehensively supporting the working environment of truck drivers and staff in logistics centers. This system includes the following means.

[1044] Route optimization

[1045] The server receives departure and destination information from the device. The device uses a GPS module to obtain the user's current location. The server uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent back to the device and presented to the user visually and audibly, allowing the user to travel efficiently and safely.

[1046] health care

[1047] Wearable devices are used to collect health data such as heart rate, number of steps, and sleep patterns. The collected data is continuously sent to a server via the device. The server analyzes the received health data and generates an alert if an abnormality is detected, notifying the user via the device. This allows users to understand their own health condition in real time and take necessary measures.

[1048] Mental support

[1049] The device periodically displays questions to the user to assess their mental state. The user's answers are sent to a server, which analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive mental health care on a daily basis.

[1050] Economical and healthy meal suggestions

[1051] When a user wants to eat, they input a request into their device. The device obtains their current location and sends it to the server. The server uses the current location information to collect information about nearby restaurants and searches for prices, menus, and health options. The optimal meal options are generated and sent to the device. This allows users to easily choose economical and healthy meals.

[1052] Real-time communication

[1053] The device receives user input via voice or text and sends it to the server. The server analyzes the input, generates an appropriate response, and sends it to the device. The device then displays or plays the response to the user, allowing the user to receive the information or support they need in real time.

[1054] Telemedicine Support

[1055] When a user feels unwell, they request telemedicine services via their device. The request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established, the device provides real-time video calls or chat functionality, allowing the user and medical professional to communicate directly.

[1056] Examples:

[1057] For example, if a staff member at a logistics center wants to use the system to optimize a delivery route, they input the departure and destination into a terminal. The server calculates the optimal route in real time and displays it on the terminal. Staff can check the route information visually and audibly, allowing them to carry out delivery work efficiently. If any abnormalities in the staff's health are detected along the way, an alert will be displayed on the terminal and instructions on how to deal with the situation will be given. The system also supports staff health management by collecting information on nearby restaurants and suggesting healthy meal options.

[1058] Example prompt sentence:

[1059] "Health data monitoring involves periodically collecting the following health information: heart rate, steps taken, and sleep duration. Based on this information, generate an application code that will alert the user if there is an abnormality and provide necessary action or connection to a medical institution."

[1060] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1061] Step 1:

[1062] The device receives the departure point and destination information from the user. At this point, the device uses the GPS module to obtain the user's current location. The inputs are the departure point, destination information, and current location data, which are then sent to the server. Upon receiving this, the server uses real-time traffic information and map data to calculate the optimal route based on the input data.

[1063] Step 2:

[1064] The server uses a real-time traffic information API and a map database to calculate the optimal route from the current location to the destination. The calculated route data is sent to the device. The device receives this route data and provides it to the user visually and audibly. The user can use the displayed route information and audio guidance to efficiently reach their destination.

[1065] Step 3:

[1066] The terminal periodically acquires health data such as heart rate, number of steps, and sleep patterns from the wearable device. The acquired health data is continuously sent to the server. When the server receives the data, it analyzes it and checks for any abnormalities. If an abnormality is detected, the server generates an alert and notifies the user via the terminal. This allows the user to become aware of the abnormality early and take appropriate action.

[1067] Step 4:

[1068] The device periodically displays questions to the user to assess their mental state. The user answers the displayed questions, and the answer data is sent to the server. The server analyzes the data and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1069] Step 5:

[1070] When a user inputs a request into the device when they want to eat, the device obtains their current location and sends it to the server. The server uses the current location information to collect information about nearby restaurants and searches for prices, menu items, and healthy options. The optimal meal options are generated and sent to the device. The user can use the displayed information to select an economical and healthy meal.

[1071] Step 6:

[1072] The device receives voice or text input from the user and sends it to the server. The server analyzes the input and generates an appropriate response. The response is then sent to the device and presented to the user visually or audibly. This allows the user to obtain the information or support they need in real time.

[1073] Step 7:

[1074] When a user feels unwell, they request telemedicine services via their device. The request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established, the device provides real-time video calls or chat functionality, allowing the user and medical professional to communicate directly, resulting in prompt and appropriate medical support.

[1075] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1076] This invention combines an emotion engine that recognizes the user's emotions in an integrated AI concierge application system to contribute to improving the working environment of truck drivers. This system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. In addition, it monitors the user's emotional state in real time and optimizes various support options based on the results.

[1077] Route optimization

[1078] The device obtains the user's current location from the GPS module and prompts the user to input their starting and destination information. This information is sent to the server, which uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[1079] health care

[1080] The device periodically acquires health data such as heart rate, number of steps, and sleep patterns from the sensor device and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[1081] Mental support

[1082] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1083] Economical meal suggestions

[1084] When a user wants to eat, they input their request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants and searches for prices, menus, and health-conscious options. The server generates optimal meal options and sends them to the device. The user reviews the proposed options and selects one.

[1085] Real-time communication

[1086] The user inputs information by voice or text, which the device recognizes and sends to the server. The server analyzes the input and generates an appropriate response. The generated response is sent to the device and displayed or played aloud to the user. This allows the user to use the concierge function to obtain appropriate information and support in real time.

[1087] Telemedicine Support

[1088] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function, allowing the user and the medical professional to communicate directly. This process allows the user to receive prompt and accurate medical support.

[1089] Emotion engine integration

[1090] The system also integrates an emotion engine to recognize the user's emotional state in real time. The emotion engine analyzes voice and facial expression data to evaluate the user's current emotional state (e.g., stress, joy, anxiety). The emotion engine's data is fed back to each of the other support tools, and their functions are adjusted based on the user's emotional state.

[1091] Specific examples

[1092] For example, if a truck driver is feeling fatigued or stressed during a long drive, the emotion engine will detect this. As a result, the mental support tool will suggest more relaxing advice or a short break. The route optimization tool will calculate and present a less stressful route (e.g., a route with less traffic) to the user. Furthermore, if an abnormality is detected in the health data (e.g., a sudden increase in heart rate), the remote medical support tool will automatically assign a medical professional to quickly diagnose and treat the problem.

[1093] In this way, the present invention provides comprehensive support for the working environment and health of truck drivers, and by optimizing the support content using an emotion engine, it aims to improve efficiency, safety, and health.

[1094] The processing flow will be explained below.

[1095] Route optimization

[1096] Step 1:

[1097] The terminal obtains the user's current location from the GPS module.

[1098] Step 2:

[1099] The terminal prompts the user to input the starting point and destination, which are then transmitted to the server.

[1100] Step 3:

[1101] The server obtains real-time traffic information via a communication network.

[1102] Step 4:

[1103] The server uses the acquired traffic information and map data to calculate the optimal route.

[1104] Step 5:

[1105] The server transmits the calculated route information to the terminal.

[1106] Step 6:

[1107] The terminal displays the received route information to the user and starts voice navigation.

[1108] Step 7:

[1109] The user follows the instructions on the terminal and starts driving along the route.

[1110] health care

[1111] Step 1:

[1112] The device periodically collects the user's health data (heart rate, number of steps, sleep patterns, etc.) from the sensor device.

[1113] Step 2:

[1114] The device transmits the acquired health data to a server.

[1115] Step 3:

[1116] The server analyzes the received health data and evaluates the user's health condition.

[1117] Step 4:

[1118] If the server detects an anomaly, it generates an alert.

[1119] Step 5:

[1120] The server sends the generated alert to the terminal.

[1121] Step 6:

[1122] The terminal receives the alert and notifies the user.

[1123] Step 7:

[1124] The user checks the notification and takes the necessary action.

[1125] Mental support

[1126] Step 1:

[1127] The terminal periodically displays questions to the user to assess their psychological state.

[1128] Step 2:

[1129] The user answers the questions and enters the answers into the terminal.

[1130] Step 3:

[1131] The terminal transmits the user's answer to the server.

[1132] Step 4:

[1133] The server analyzes the user's response data and evaluates their mental state.

[1134] Step 5:

[1135] The server generates appropriate advice based on the analysis results.

[1136] Step 6:

[1137] The server transmits the generated advice to the terminal.

[1138] Step 7:

[1139] The terminal displays the advice to the user and provides instructions.

[1140] Step 8:

[1141] The user confirms and implements the advice.

[1142] Economical meal suggestions

[1143] Step 1:

[1144] The user inputs a request into the terminal when they want to eat.

[1145] Step 2:

[1146] The terminal obtains the user's current location and transmits it to the server.

[1147] Step 3:

[1148] The server collects information about nearby restaurants based on the current location information.

[1149] Step 4:

[1150] The server analyzes the collected restaurant menus, prices, and health options.

[1151] Step 5:

[1152] The server generates optimal meal options and sends them to the device.

[1153] Step 6:

[1154] The terminal displays suggested restaurants and menus to the user.

[1155] Step 7:

[1156] The user selects and visits the suggested restaurant.

[1157] Real-time communication

[1158] Step 1:

[1159] The user inputs information into the terminal by voice or text.

[1160] Step 2:

[1161] The terminal recognizes the input and sends it to the server.

[1162] Step 3:

[1163] The server parses the input and generates an appropriate response.

[1164] Step 4:

[1165] The server generates a response and sends it to the terminal.

[1166] Step 5:

[1167] The terminal displays or plays the response aloud to the user.

[1168] Step 6:

[1169] Users can obtain information while enjoying interacting with the terminal.

[1170] Telemedicine Support

[1171] Step 1:

[1172] When a user feels unwell, the user inputs a request for remote medical services from the terminal.

[1173] Step 2:

[1174] The terminal sends a request to the server.

[1175] Step 3:

[1176] The server receives the request and assigns the appropriate medical professional.

[1177] Step 4:

[1178] The server establishes a connection with the medical professional and notifies the terminal.

[1179] Step 5:

[1180] The device provides real-time video calling or chat functionality to facilitate communication between users and medical professionals.

[1181] Step 6:

[1182] A medical professional will review the user's symptoms and provide a diagnosis and advice.

[1183] Step 7:

[1184] The device displays the medical professional's diagnosis and advice to the user.

[1185] Step 8:

[1186] The user takes action according to the advice provided.

[1187] Emotion engine integration

[1188] Step 1:

[1189] The terminal acquires the user's voice and facial expression data from a camera and microphone.

[1190] Step 2:

[1191] The terminal transmits the acquired data to the server.

[1192] Step 3:

[1193] The server analyzes the voice data and facial expression data to assess the user's emotional state.

[1194] Step 4:

[1195] The server sends feedback to the mental support means and the travel route optimization means based on the emotional state.

[1196] Step 5:

[1197] The server generates advice and a less stressful route according to the user's emotional state.

[1198] Step 6:

[1199] The server transmits the generated content to the terminal.

[1200] Step 7:

[1201] The device displays appropriate advice and routes to the user based on their emotional state.

[1202] Specific examples

[1203] For example, if a truck driver begins to feel tired after a long drive, the emotion engine will detect this emotion and analyze the driver's voice and facial expression data during the drive. As a result, the server will enhance mental support measures, suggesting relaxation advice and short breaks. In addition, the route optimization tool will recalculate a route with better road conditions to reduce stress and notify the user. Furthermore, if an abnormality is detected in the user's health data, the system will respond quickly and enable remote medical support. This will improve the overall health and mental state of truck drivers.

[1204] Example 2

[1205] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1206] Conventional truck driver systems provide separate functions for route optimization, health management, mental support, meal suggestions, real-time communication, and remote medical support, and the functions are not well integrated. In particular, the user's emotional state is not reflected in real time, making it difficult to receive optimal support. Furthermore, data sharing between different devices and platforms is not smooth, creating a need for a system that truck drivers can use effectively.

[1207] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1208] In this invention, the server includes a means for optimizing a driving route, a means for acquiring and analyzing health data, a means for providing mental support, a means for suggesting economical and healthy meals, a means for real-time communication with a user, a means for providing remote medical support, and a means for recognizing the user's emotional state and providing feedback to the other means. This allows truck drivers to receive integrated support in real time that is linked between different functions, enabling optimal support that takes into account the user's emotional state.

[1209] "User" refers to the entity that uses this system, specifically truck drivers.

[1210] "Server" refers to a central control device that manages data, analyzes it, generates responses, and other processes.

[1211] A "terminal" is a device used by a user, such as a smartphone or tablet, that communicates with a server.

[1212] "Route optimization means" refers to a function that calculates the optimal route using real-time traffic information and map data based on the departure point and destination specified by the user.

[1213] "Health data acquisition means" refers to a function that acquires health data such as the user's heart rate, number of steps, and sleep patterns from the sensor device and transmits that data to a server.

[1214] "Mental support means" refers to a function that evaluates the user's psychological state and provides appropriate advice and care.

[1215] "Economical and healthy meal suggestion means" refers to a function that collects information on nearby restaurants based on the user's current location and suggests meal options that take price and health into consideration.

[1216] "Real-time communication means" refers to functionality that allows for the immediate exchange of information between the user and the system, and is done through voice input or text input.

[1217] "Telemedical support means" refers to a function that allows users to remotely access specialists when they are unwell and receive diagnosis and treatment.

[1218] "Emotion engine" refers to a system that analyzes a user's voice data and facial expression data to recognize the user's emotional state in real time.

[1219] This invention combines an emotion engine that recognizes the user's emotions in an integrated AI concierge application system to contribute to improving the working environment of truck drivers. This system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. In addition, it monitors the user's emotional state in real time and optimizes various support options based on the results.

[1220] Route optimization

[1221] The device uses a GPS module to obtain the user's current location and prompts the user to input starting and destination information. This information is sent to a server, which uses real-time traffic information and map data (e.g., Google Maps API) to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing the user to confirm route information both visually and audibly.

[1222] health care

[1223] The device periodically obtains health data such as heart rate, number of steps, and sleep patterns from sensor devices (e.g., Fitbit, Apple Watch) and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[1224] Mental support

[1225] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers (e.g., Google Cloud NLP API) and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1226] Economical meal suggestions

[1227] When a user wants to eat, they input a request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants (e.g., Yelp API, Google Places API) and searches for prices, menus, and health-conscious options. The optimal meal options are generated and sent to the device. The user reviews the proposed options and selects one.

[1228] Real-time communication

[1229] The user inputs information via voice or text, which the device recognizes and sends to the server. The server analyzes the input (e.g., Google Cloud NLP API) and generates an appropriate response. The response is then sent to the device and displayed or played aloud to the user. This allows the user to utilize the concierge function to receive appropriate information and support in real time.

[1230] Telemedicine Support

[1231] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function (e.g., Zoom API, Microsoft Teams API) for direct communication between the user and the medical professional. This process allows the user to receive prompt and accurate medical support.

[1232] Emotion engine integration

[1233] The system also integrates an emotion engine to recognize the user's emotional state in real time. The emotion engine analyzes voice and facial expression data to evaluate the user's current emotional state (e.g., stress, joy, anxiety). The emotion engine's data is fed back to each of the other support tools, and their functions are adjusted based on the user's emotional state.

[1234] Specific examples

[1235] For example, if a truck driver is feeling fatigued or stressed during a long drive, the emotion engine will detect this. As a result, the mental support tool will suggest more relaxing advice or a short break. The route optimization tool will calculate and present a less stressful route (e.g., a route with less traffic) to the user. Furthermore, if an abnormality is detected in the health data (e.g., a sudden increase in heart rate), the remote medical support tool will automatically assign a medical professional to quickly diagnose and treat the problem.

[1236] Prompt Sentence Examples

[1237] "Can you please tell me a simple program that evaluates the user's emotional state and optimizes the route accordingly?"

[1238] "Can you give us an example of a program that suggests nearby healthy food options based on the user's current location?"

[1239] "How can we assess a user's emotional state in real time and provide appropriate advice?"

[1240] In this way, the present invention provides comprehensive support for the working environment and health of truck drivers, and by optimizing the support content using an emotion engine, it aims to improve efficiency, safety, and health.

[1241] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1242] Route optimization

[1243] Step 1: User enters start and destination

[1244] The user inputs the starting point and destination information into the terminal, and this data is sent to the server in text format.

[1245] Step 2: The device obtains its current location

[1246] The device uses a built-in GPS module to obtain the user's current location in real time, and this location information (latitude and longitude) is sent to the server.

[1247] Step 3: The device sends the data to the server

[1248] The device transmits the starting point, destination, and current location to the server. The transmitted data includes location information, and the server analyzes the data based on that information.

[1249] Step 4: The server calculates the optimal route

[1250] The server uses the received departure point, destination, and current location information to reference real-time traffic information and map data (e.g., Google Maps API), and calculates the optimal route. The calculation results are generated in JSON format.

[1251] Step 5: The server sends the calculation results to the terminal

[1252] The server then sends the calculated optimal route data to the device, including detailed directions and estimated arrival times.

[1253] Step 6: The device displays the route information to the user.

[1254] The device then displays the received optimal route information to the user, and voice navigation begins along with the visual map display.

[1255] health care

[1256] Step 1: The device acquires data from the sensor device

[1257] The device collects health data such as heart rate, steps, and sleep patterns from sensor devices (e.g., Fitbit, Apple Watch) via Bluetooth or Wi-Fi.

[1258] Step 2: The device sends the health data to the server

[1259] The device periodically transmits the acquired health data, including heart rate, number of steps, and sleep data, to a server.

[1260] Step 3: The server analyzes the data

[1261] The server uses the received health data to analyze it using Python libraries such as Pandas and NumPy, assessing the user's health status and calculating the average and standard deviation.

[1262] Step 4: The server detects an anomaly

[1263] Based on the analysis results, the server generates an alert if an abnormal value exceeding the set threshold is detected.

[1264] Step 5: The device notifies the user of the alert

[1265] The device receives alerts from the server and notifies the user, including advice on how to deal with abnormal health conditions and suggestions for consulting a medical institution.

[1266] Mental support

[1267] Step 1: The device displays questions to assess your emotional state

[1268] The device periodically displays questions to the user to assess their psychological state (e.g., "How are you feeling today?").

[1269] Step 2: User answers questions

[1270] The user inputs answers to the displayed questions, and the input data is sent to the terminal in text format.

[1271] Step 3: The device sends the answer to the server

[1272] The terminal transmits the user's answer data to the server, which includes the question and the corresponding user's answer.

[1273] Step 4: The server parses the answer

[1274] The server analyzes the received answers using text analysis (e.g., Google Cloud NLP API) and evaluates the user's mental state.

[1275] Step 5: Server generates advice

[1276] The server generates appropriate advice based on the analysis results, including methods for relaxation and stress relief. The generated results are output in JSON format.

[1277] Step 6: The device provides advice to the user

[1278] The terminal displays the advice received from the server to the user, using diagrams and text.

[1279] Economical meal suggestions

[1280] Step 1: User enters meal request

[1281] The user inputs a request into the device when they want to eat, and the input data is saved in text format.

[1282] Step 2: The device obtains its current location

[1283] The device uses the built-in GPS module to obtain the user's current location, and the location data is sent to the server in latitude and longitude format.

[1284] Step 3: The device sends a request to the server

[1285] The terminal transmits its current location and a request to the server. The transmitted data includes the user's desired content.

[1286] Step 4: Server collects restaurant information

[1287] The server collects information about nearby restaurants using APIs (e.g., Yelp API, Google Places API). The collected data includes restaurant names, menus, and price information.

[1288] Step 5: The server makes a recommendation based on the criteria.

[1289] The server analyzes the collected data and generates optimal dining options based on price, menu, and health-conscious options, outputting the recommendation results in JSON format.

[1290] Step 6: Your device will display meal options

[1291] The terminal displays the meal options received from the server to the user, who can then review the suggested options and select the meal of their choice.

[1292] Real-time communication

[1293] Step 1: User provides voice or text input

[1294] Users input questions or requests into the device by voice or text, and the voice data is converted into text (e.g., Google Speech-to-Text API).

[1295] Step 2: The device sends the input data to the server

[1296] The device sends voice and text input data to the server, including the user's question.

[1297] Step 3: The server parses the input

[1298] The server parses the received input data (e.g., Google Cloud NLP API) and generates an appropriate response, which is created using a generative AI model.

[1299] Step 4: Server generates response

[1300] The server uses a generative AI model (e.g., OpenAI's GPT-4) to create an appropriate response and outputs it in JSON format.

[1301] Step 5: The device displays or plays a response to the user

[1302] The terminal displays or plays a response received from the server to the user, using text and audio for display.

[1303] Telemedicine Support

[1304] Step 1: User enters telehealth request

[1305] Users input remote medical care requests into the terminal when they feel unwell, and the request data is recorded in text format.

[1306] Step 2: The device sends a request to the server

[1307] The terminal transmits request data to the server, which includes information about the user's poor physical condition.

[1308] Step 3: The server assigns a medical professional

[1309] The server assigns the appropriate medical professional based on the received request, and the assignment result is output in JSON format.

[1310] Step 4: Connect your device to a medical professional

[1311] The device provides real-time video calling or chat functionality for direct communication between users and medical professionals. Video calling uses APIs (e.g., Zoom API, Microsoft Teams API).

[1312] Step 5: Providing medical support

[1313] Medical professionals provide users with diagnoses and treatments, which are communicated to them in real time.

[1314] Emotion engine integration

[1315] Step 1: The device acquires voice and facial expression data

[1316] The device uses a camera and microphone to capture the user's voice and facial expression data, which is collected in real time.

[1317] Step 2: The device sends the data to the server

[1318] The device transmits the acquired voice data and facial expression data to the server. The transmitted data includes voice files and image data.

[1319] Step 3: The server evaluates the emotional state

[1320] The server uses an emotion engine to analyze the voice and facial expression data and evaluate the user's emotional state, outputting the evaluation results in JSON format.

[1321] Step 4: The server feeds the results back to each support function

[1322] The server then provides feedback to each of the other support functions based on the analysis results, adjusting each function based on the user's emotional state. The feedback data includes recommended actions.

[1323] (Application example 2)

[1324] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1325] The logistics industry is required to improve employee operational efficiency while also providing integrated health and mental health care. However, in current systems, these elements exist independently, making it difficult to provide consistent support. Furthermore, there is no adequate system in place to recognize employees' emotional states in real time and provide optimal support based on that information. This results in insufficient improvements to the working environment and adaptive support for individual employees.

[1326] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for optimizing a travel route, a means for acquiring and analyzing health data, a means for providing mental support, a means for suggesting economical and healthy meals, a means for communicating with the user in real time, a means for providing remote medical support, and an emotion engine that recognizes the user's emotions and optimizes various functions. This makes it possible to comprehensively support the working environment and health of logistics industry workers and provide optimal support according to their emotional state.

[1327] The "logistics industry" refers to the industry that systematically transports, stores, and delivers goods.

[1328] "Employee" means a person engaged in a particular job or activity.

[1329] A "route" is a means of transportation or a route from a specific point to a destination.

[1330] "Optimization" refers to achieving the best possible state under specific conditions.

[1331] "Health Data" means information that describes a person's physical health, such as heart rate, number of steps taken, and sleep patterns.

[1332] "Mental support" refers to the provision of psychological advice and assistance.

[1333] "Dietary suggestions" refers to providing information about food to encourage better choices.

[1334] "Real-time communication" refers to the instantaneous exchange of information at the same time.

[1335] "Telehealth support" refers to the provision of medical-related assistance or services from a physically distant location.

[1336] An "emotion engine" is a system or algorithm that analyzes a user's emotional state and responds appropriately based on that information.

[1337] A "server" is a computer system that provides services to clients over a network.

[1338] This invention is an integrated AI concierge application system for logistics industry professionals. The system provides route optimization, health management, mental support, economical and healthy meal suggestions, real-time communication, remote medical support, and various support optimization functions using an emotion engine.

[1339] The server includes the following means:

[1340] 1. Route optimization measures:

[1341] The server calculates the optimal route based on the user's current location obtained from the GPS module and the destination information entered by the user, using real-time traffic information and map data. The results of this calculation are sent to the device and displayed. In addition, voice navigation is provided, allowing the user to confirm route information both visually and audibly.

[1342] 2. Health management measures:

[1343] The server periodically collects and analyzes health data such as heart rate, step count, and sleep patterns from the sensor device. If an abnormality is detected, an alert is generated and notified to the user via the device, allowing the user to take prompt action.

[1344] 3. Mental support measures:

[1345] The server analyzes the user's answers to questions displayed on the device to assess their psychological state. Based on the analysis results, it generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1346] 4. Economical and healthy meal suggestions:

[1347] The server receives a request from the user when they want to eat, obtains their current location, and then searches for nearby restaurants based on price, menu, and health-conscious options. Based on this information, it generates optimal meal options and sends them to the user.

[1348] 5. Real-time communication methods:

[1349] The server analyzes the user's voice or text input and generates an appropriate response, which is sent to the device and displayed or played aloud to the user, providing instant information or assistance.

[1350] 6. Telemedicine support methods:

[1351] The server allows users to request telemedicine services via their device when they feel unwell. The server then assigns an appropriate medical professional to the user. Once a connection with the medical professional is established, the device provides real-time video calls and chat functions.

[1352] 7. Emotion Engine:

[1353] The server analyzes the voice data and facial expression data to recognize the user's emotional state in real time. The data analyzed by the emotion engine is fed back to each of the other support means, and the support provided is adjusted based on the user's emotional state.

[1354] Specific examples

[1355] For example, if an employee working in a logistics center wearing smart glasses feels fatigued after working for a long time, the emotion engine will detect this and provide mental support, suggesting relaxation advice or a short break, while the route optimization tool will calculate a less stressful route and change work instructions.

[1356] Prompt Sentence Examples

[1357] "We are developing an integrated AI concierge application system for employees working in logistics centers to improve their working environment. The system combines an emotion engine that recognizes the user's emotions and provides the following functions: route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. This system uses smartphones, smart glasses, and head-mounted displays. Please explain in detail how the system processes data and achieves each function."

[1358] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1359] Step 1:

[1360] When a user wants to optimize their route, they input their current location and destination into the device. This information is acquired using a GPS module and sent to the server. The server uses real-time traffic information and map data to calculate the optimal route based on this input and sends the results to the device. The device then displays the calculation results and provides voice navigation.

[1361] Step 2:

[1362] The device collects data from sensor devices so that users can regularly monitor their health data, such as heart rate, steps, and sleep patterns. This data is then sent to a server where it is analyzed. If an abnormal value is detected, the server generates an alert and sends a notification to the user via the device. The user can then take appropriate action based on the alert content.

[1363] Step 3:

[1364] The device periodically displays questions to the user to assess their psychological state. The data the user answers is sent to a server, where natural language analysis is performed. Based on the analysis results, the server generates appropriate mental support advice and sends it to the device. The user can then review this advice and receive mental health care.

[1365] Step 4:

[1366] When a user wants to eat, they input a request into their device. The device obtains their current location information and sends it to the server. The server then collects information about nearby restaurants based on their current location and searches for prices, menus, and health-conscious options. The best meal options are generated and sent back to the device. The user can review this information and make a selection.

[1367] Step 5:

[1368] When a user inputs something using voice or text, the device recognizes it and sends it to the server. The server analyzes the input and generates an appropriate response. The response is then sent to the device and displayed to the user or played aloud, allowing the user to instantly access the information or support they need.

[1369] Step 6:

[1370] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established with the medical professional, the device provides real-time video calls and chat functions, allowing the user to communicate directly with the professional.

[1371] Step 7:

[1372] The device captures voice and facial expression data using a camera and microphone and sends it to a server. The server then uses an emotion recognition algorithm to analyze the user's emotional state and feeds the analysis results back to other devices. The support provided is adjusted based on the emotional data.

[1373] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1374] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1375] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1376] [Third embodiment]

[1377] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1378] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1379] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1380] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1381] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1382] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1383] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1384] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1385] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1386] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1387] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1388] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1389] This invention is an integrated AI concierge application system to contribute to improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[1390] Route optimization

[1391] The device obtains the user's current location from the GPS module and prompts the user to input their starting and destination information. This information is sent to the server, which uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[1392] health care

[1393] The device periodically acquires health data such as heart rate, number of steps, and sleep patterns from the sensor device and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[1394] Mental support

[1395] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1396] Economical meal suggestions

[1397] When a user wants to eat, they input their request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants and searches for prices, menus, and health-conscious options. The server generates optimal meal options and sends them to the device. The user reviews the proposed options and selects one.

[1398] Real-time communication

[1399] The user inputs information by voice or text, which the device recognizes and sends to the server. The server analyzes the input and generates an appropriate response. The generated response is sent to the device and displayed or played aloud to the user. This allows the user to use the concierge function to obtain appropriate information and support in real time.

[1400] Telemedicine Support

[1401] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function, allowing the user and the medical professional to communicate directly. This process allows the user to receive prompt and accurate medical support.

[1402] Specific examples

[1403] For example, when a truck driver departs from a warehouse in a city to head to a distant delivery destination, he or she inputs the destination into the device before setting off. The server calculates the optimal route in real time and displays it on the device. While driving, the device regularly monitors the driver's heart rate and number of steps, and if an abnormality is detected, the server generates an alert and notifies the user. Furthermore, when the driver wants to eat during a delivery, the driver sends a request from the device, and the server searches for nearby restaurants and suggests the best meal options. Furthermore, if the driver feels tired or stressed after a long drive, they can use the device's conversation function to receive mental support.

[1404] In this way, the present invention provides a system that can comprehensively support the working environment and health of truck drivers and improve their efficiency and safety.

[1405] The processing flow will be explained below.

[1406] Route optimization

[1407] Step 1:

[1408] The device obtains the user's current location from the GPS module.

[1409] Step 2:

[1410] The terminal prompts the user to input the starting point and destination, which are then transmitted to the server.

[1411] Step 3:

[1412] The server obtains real-time traffic information via a communication network.

[1413] Step 4:

[1414] The server uses the acquired traffic information and map data to calculate the optimal route.

[1415] Step 5:

[1416] The server transmits the calculated route information to the terminal.

[1417] Step 6:

[1418] The terminal displays the received route information to the user and starts voice navigation.

[1419] Step 7:

[1420] The user follows the instructions on the terminal and starts driving along the route.

[1421] health care

[1422] Step 1:

[1423] The device periodically collects the user's health data (heart rate, number of steps, sleep patterns, etc.) from the sensor device.

[1424] Step 2:

[1425] The device transmits the acquired health data to a server.

[1426] Step 3:

[1427] The server analyzes the received health data and evaluates the user's health condition.

[1428] Step 4:

[1429] If the server detects an anomaly, it generates an alert.

[1430] Step 5:

[1431] The server sends the generated alert to the terminal.

[1432] Step 6:

[1433] The terminal receives the alert and notifies the user.

[1434] Step 7:

[1435] The user checks the notification and takes the necessary action.

[1436] Mental support

[1437] Step 1:

[1438] The terminal periodically displays questions to the user to assess their psychological state.

[1439] Step 2:

[1440] The user answers the questions and enters the answers into the terminal.

[1441] Step 3:

[1442] The terminal transmits the user's answer to the server.

[1443] Step 4:

[1444] The server analyzes the user's response data and evaluates their mental state.

[1445] Step 5:

[1446] The server generates appropriate advice based on the analysis results.

[1447] Step 6:

[1448] The server transmits the generated advice to the terminal.

[1449] Step 7:

[1450] The terminal displays the advice to the user and provides instructions.

[1451] Step 8:

[1452] The user confirms and implements the advice.

[1453] Economical meal suggestions

[1454] Step 1:

[1455] The user inputs a request into the terminal when they want to eat.

[1456] Step 2:

[1457] The terminal obtains the user's current location and transmits it to the server.

[1458] Step 3:

[1459] The server collects information about nearby restaurants based on the current location information.

[1460] Step 4:

[1461] The server analyzes the collected restaurant menus, prices, and health options.

[1462] Step 5:

[1463] The server generates optimal meal options and sends them to the device.

[1464] Step 6:

[1465] The terminal displays suggested restaurants and menus to the user.

[1466] Step 7:

[1467] The user selects and visits the suggested restaurant.

[1468] Real-time communication

[1469] Step 1:

[1470] The user inputs information into the terminal by voice or text.

[1471] Step 2:

[1472] The terminal recognizes the input and sends it to the server.

[1473] Step 3:

[1474] The server parses the input and generates an appropriate response.

[1475] Step 4:

[1476] The server generates a response and sends it to the terminal.

[1477] Step 5:

[1478] The terminal displays or plays the response aloud to the user.

[1479] Step 6:

[1480] Users can obtain information while enjoying interacting with the terminal.

[1481] Telemedicine Support

[1482] Step 1:

[1483] When a user feels unwell, the user inputs a request for remote medical services from the terminal.

[1484] Step 2:

[1485] The terminal sends a request to the server.

[1486] Step 3:

[1487] The server receives the request and assigns the appropriate medical professional.

[1488] Step 4:

[1489] The server establishes a connection with the medical professional and notifies the terminal.

[1490] Step 5:

[1491] The device provides real-time video calling or chat functionality to facilitate communication between users and medical professionals.

[1492] Step 6:

[1493] A medical professional will review the user's symptoms and provide a diagnosis and advice.

[1494] Step 7:

[1495] The device displays the medical professional's diagnosis and advice to the user.

[1496] Step 8:

[1497] The user takes action according to the advice provided.

[1498] Example 1

[1499] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1500] Truck drivers often drive long hours and work in harsh environments. This requires efficient and safe routes, health management and mental support, a balanced diet, and prompt medical support. However, no system has previously existed that provides all of these services in an integrated manner. As a result, drivers are often exposed to the risk of overwork, stress, unhealthy eating, and delays and accidents due to inappropriate driving routes. A comprehensive system to solve these issues is needed.

[1501] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1502] In this invention, the server includes means for acquiring a current location, means for inputting and transmitting start and destination information, means for calculating an optimal driving route using real-time traffic information and map data, means for periodically acquiring and transmitting health data, means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected, means for displaying questions to assess a driver's mental state, acquiring and transmitting answers, means for analyzing the answers to evaluate the driver's mental state and generating appropriate advice, means for inputting a meal request and acquiring current location information, means for collecting information on nearby restaurants and searching for prices, menus, and health-conscious options, means for recognizing and analyzing voice or text input, means for requesting remote medical services and assigning an appropriate medical professional, and means for connecting with the medical professional and providing a video call or chat function. This allows drivers to receive multiple necessary services, such as efficient driving routes, health management, mental support, provision of balanced meals, and prompt remote medical support, all in one place.

[1503] The "means for acquiring the current location" is a device including a GPS module and a sensor device used to acquire the user's location information.

[1504] The "means for inputting and transmitting information on the starting point and destination" refers to an interface and communication means for the user to input the starting point and destination and transmit that information to the server.

[1505] "Means for calculating optimal driving routes using real-time traffic information and map data" refers to a system that includes an algorithm and database for obtaining traffic conditions and map data in real time and calculating optimal driving routes based on that information.

[1506] The "means for periodically acquiring and transmitting health data" is a device that includes communication means for periodically acquiring a user's health data from a sensor device and transmitting that data to a server.

[1507] The "means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected" refers to software and algorithms that allow the server to analyze the user's health data received and generate and notify an alert if an abnormality is detected.

[1508] The "means for displaying questions to evaluate the psychological state and acquiring and transmitting answers" refers to an interface and communication means for displaying questions to evaluate the user's psychological state on a terminal, acquiring the user's answers, and transmitting them to a server.

[1509] The "means for analyzing the answers, assessing the mental state, and generating appropriate advice" refers to software and algorithms that allow the server to analyze the user's answers, assess the mental state, and generate appropriate advice based on the results.

[1510] The "means for inputting a meal request and obtaining current location information" is a device that includes an interface and a GPS module for a user to input a meal request and obtain current location information at that time.

[1511] "Means for collecting information about nearby restaurants and searching for prices, menus, and health-conscious options" refers to software and a database for collecting information about nearby restaurants based on the user's current location information and searching for prices, menus, and health-conscious options.

[1512] "Means for recognizing and analyzing voice or text input" refers to language processing algorithms and software for recognizing a user's voice or text input and analyzing its content.

[1513] "Means for requesting telehealth services and assigning appropriate medical professionals" refers to systems and software for accepting a user's request for telehealth services and selecting and assigning an appropriate medical professional based on the request.

[1514] "Means for connecting with medical professionals and providing video call or chat functionality" refers to an interface and communication means for users and medical professionals to communicate in real time via video call or chat.

[1515] This invention is an integrated AI concierge application system for comprehensively improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[1516] Route optimization

[1517] The device uses a GPS module to obtain the user's current location and prompts the user to input their starting and destination information. This information is sent to a server, which uses real-time traffic information and map data to calculate the optimal route. The results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[1518] As a concrete example, if a user inputs starting point A and destination B, the server will use real-time traffic information and map data (e.g., Google Maps API) to calculate the optimal route and display a notification on the device such as "Highway Route 1 is the shortest."

[1519] Example prompt sentence:

[1520] "Calculate the best route from point A to point B."

[1521] health care

[1522] The device periodically acquires health data such as heart rate, step count, and sleep patterns from a sensor device (e.g., Fitbit) and sends it to a server. The server analyzes the received health data and evaluates the user's health status. If an abnormality is detected, the server generates an alert and notifies the user via the device.

[1523] As a specific example, if a user's heart rate shows abnormalities, the server generates an alert such as "Your heart rate is dropping. Please consult a medical institution" and notifies the device.

[1524] Example prompt sentence:

[1525] "Generate a notification message if an abnormal heart rate is detected."

[1526] Mental support

[1527] The device periodically asks the user questions to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device.

[1528] For example, if a user types, "I've been feeling tired lately. What should I do?", the server will respond with advice such as, "Try taking some deep breaths to relax."

[1529] Example prompt sentence:

[1530] "Please suggest ways for users who have been feeling tired recently to relax."

[1531] Economical meal suggestions

[1532] When a user wants to eat, they input their request into their device, which then acquires their current location. The server uses this location information to gather information about nearby restaurants, searching for prices, menus, and health-conscious options. The best meal options are then sent to the device and displayed to the user.

[1533] For example, if a user types, "Tell me where I can get a cheap, healthy meal nearby," the server will notify the device of the result, such as, "XYZ Restaurant, salads for 550 yen."

[1534] Example prompt sentence:

[1535] "Suggest economical and healthy food options near the user's current location."

[1536] Real-time communication

[1537] The user provides input via voice or text, which the device recognizes and sends to the server, which analyzes the input and generates an appropriate response, which is then sent to the device and displayed or played aloud to the user.

[1538] As a specific example, if a user voice-inputs "What's the weather going to be like tomorrow?", the server retrieves information from a weather forecast service (e.g., the OpenWeather API) and generates a response such as "It's going to be sunny tomorrow."

[1539] Example prompt sentence:

[1540] "Please tell me the weather forecast for tomorrow."

[1541] Telemedicine Support

[1542] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established with the medical professional, the device provides real-time video calls or chat functionality, allowing the user and the medical professional to communicate directly.

[1543] For example, if a user inputs "I have a persistent headache and would like to speak to a doctor," the server will assign a medical professional and start a video call. The medical professional will communicate with the user by asking them to explain their symptoms in detail.

[1544] Example prompt sentence:

[1545] "Generate initial diagnostic questions for users suffering from headaches."

[1546] In this way, the integrated AI concierge application system of the present invention is a system that can comprehensively support the working environment and health of truck drivers, and improve efficiency and safety.

[1547] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1548] Route optimization

[1549] Step 1:

[1550] The terminal uses a GPS module to obtain the user's current location.

[1551] Input: Location information from GPS module

[1552] Output: Current location (e.g., latitude 34.0522, longitude -118.2437)

[1553] Specific behavior:

[1554] The device obtains its current location information of "latitude 34.0522, longitude -118.2437".

[1555] Step 2:

[1556] The user inputs the departure point and destination information into the terminal.

[1557] Input: Departure point and destination information (e.g., point A and point B)

[1558] Output: User input data

[1559] Specific behavior:

[1560] The user inputs "starting point A" and "destination B" into the terminal.

[1561] Step 3:

[1562] The terminal transmits the acquired current location, departure point, and destination information to the server.

[1563] Input: current location, starting point, destination information

[1564] Output: Data sent to the server

[1565] Specific behavior:

[1566] The device sends the data "starting point A, destination B, current location (latitude 34.0522, longitude -118.2437)" to the server.

[1567] Step 4:

[1568] The server uses real-time traffic information and map data to calculate the optimal route.

[1569] Input: Data sent to the server, traffic information, map data

[1570] Output: Optimal route

[1571] Specific behavior:

[1572] The server uses the Google Maps API to request the "shortest route from starting point A to destination B" and calculates the optimal route.

[1573] Step 5:

[1574] The server sends the calculation results to the terminal, which displays the results to the user.

[1575] Input: Optimal route

[1576] Output: Data displayed to the user

[1577] Specific behavior:

[1578] The server sends route information to the terminal stating, "Route 1 using the expressway is the shortest route."

[1579] The device displays the route on the screen and provides voice guidance.

[1580] health care

[1581] Step 1:

[1582] The device periodically collects health data such as heart rate, steps taken, and sleep patterns from sensor devices.

[1583] Input: Health data from sensor devices

[1584] Output: Retrieved health data

[1585] Specific behavior:

[1586] The device receives the following data from Fitbit: Heart rate: 72 bpm, Steps: 3000, Sleep time: 7 hours.

[1587] Step 2:

[1588] The device transmits the acquired health data to a server.

[1589] Input: Acquired health data

[1590] Output: Data sent to the server

[1591] Specific behavior:

[1592] The device sends the following data to the server: heart rate: 72 bpm, steps: 3000, sleep time: 7 hours.

[1593] Step 3:

[1594] The server analyzes the received health data and evaluates the user's health condition.

[1595] Input: Health data sent to the server

[1596] Output: Health status assessment results

[1597] Specific behavior:

[1598] The server analyzes the received data and evaluates it as follows: "A heart rate of 72 bpm is normal, 3,000 steps is half the recommended number, and 7 hours of sleep is sufficient."

[1599] Step 4:

[1600] If an abnormality is detected, the server generates an alert and notifies the user via their terminal.

[1601] Input: Health status assessment results

[1602] Output: Alert

[1603] Specific behavior:

[1604] The server generates an alert saying, "Your step count is low, so walk more," and sends it to the device.

[1605] The device will display an alert to the user and notify them via audio.

[1606] Mental support

[1607] Step 1:

[1608] The terminal periodically displays questions to the user to assess their psychological state and obtains the user's answers.

[1609] Input: User's answer

[1610] Output: The answer obtained

[1611] Specific behavior:

[1612] The device displays the question "Have you been feeling stressed lately?" and the user answers "Yes."

[1613] Step 2:

[1614] The terminal transmits the user's answer to the server.

[1615] Input: The answer obtained

[1616] Output: The answer sent to the server

[1617] Specific behavior:

[1618] The terminal sends the answer "yes" to the server.

[1619] Step 3:

[1620] The server analyzes the answers and evaluates the user's mental state.

[1621] Input: The answer sent to the server

[1622] Output: Mental state evaluation results

[1623] Specific behavior:

[1624] The server analyzes the responses and assesses that "stress may be increasing."

[1625] Step 4:

[1626] The server generates appropriate advice based on the analysis results and provides it to the user via the terminal.

[1627] Input: Mental state assessment results

[1628] Output: Generated advice

[1629] Specific behavior:

[1630] The server generates advice such as "Try deep breathing to relax" and sends it to the terminal.

[1631] The terminal displays the advice to the user and provides voice guidance.

[1632] Economical meal suggestions

[1633] Step 1:

[1634] When the user wants to eat, they input a request into the terminal, and the terminal acquires their current location.

[1635] Input: Meal request, current location information

[1636] Output: Retrieved request and location information

[1637] Specific behavior:

[1638] A user requests, "Tell me where I can get a cheap, healthy meal nearby."

[1639] The device obtains location information from GPS as "latitude 34.0522, longitude -118.2437".

[1640] Step 2:

[1641] The server collects information about nearby restaurants based on the current location information.

[1642] Input: Current location information

[1643] Output: Collected restaurant information

[1644] Specific behavior:

[1645] The server calls the Yelp API and collects restaurant information based on the location information "latitude 34.0522, longitude -118.2437".

[1646] Step 3:

[1647] The server uses the collected information to search for prices, menus, and health-conscious options.

[1648] Input: Collected restaurant information

[1649] Output: Best meal options

[1650] Specific behavior:

[1651] The server analyzes the data and selects healthy options such as "XYZ restaurant, salad for 550 yen."

[1652] Step 4:

[1653] The server sends the results to the terminal, which displays the information to the user.

[1654] Enter: Best Meal Options

[1655] Output: Data displayed to the user

[1656] Specific behavior:

[1657] The server sends the optimal option, "XYZ Restaurant, salad for 550 yen," to the terminal.

[1658] The device displays this to the user and notifies them with a voice message saying, "We recommend the nearby XYZ restaurant."

[1659] Real-time communication

[1660] Step 1:

[1661] The user inputs data by voice or text, which the device recognizes and sends to the server.

[1662] Input: User voice or text input

[1663] Output: Recognized text data

[1664] Specific behavior:

[1665] The user speaks, "Tell me what the weather will be like tomorrow."

[1666] The device converts the voice into text and sends it to the server.

[1667] Step 2:

[1668] The server parses the input and generates an appropriate response.

[1669] Input: Recognized text data

[1670] Output: The generated response

[1671] Specific behavior:

[1672] The server analyzes "What's the weather like tomorrow?"

[1673] Obtain data such as "It will be sunny tomorrow" from a weather forecast service (e.g., OpenWeather API).

[1674] Step 3:

[1675] The server sends the response to the terminal, which displays or plays it aloud to the user.

[1676] Input: Generated response

[1677] Output: Data displayed or played back to the user

[1678] Specific behavior:

[1679] The server responds by sending the message "It will be sunny tomorrow" to the terminal.

[1680] The device will display this and play a voice saying "Tomorrow will be sunny."

[1681] Telemedicine Support

[1682] Step 1:

[1683] When a user feels unwell, they request a remote medical service via their terminal.

[1684] Input: Telehealth service request

[1685] Output: Request data to the server

[1686] Specific behavior:

[1687] The user enters a request saying, "I'm not feeling well and would like to talk to a doctor."

[1688] The device sends a request to the server.

[1689] Step 2:

[1690] The server receives the request and assigns the appropriate medical professional.

[1691] Input: Request data, medical professional database

[1692] Output: Assigned medical professional

[1693] Specific behavior:

[1694] The server selects and assigns the most suitable medical professional from a doctor database.

[1695] Step 3:

[1696] The server establishes a connection with a medical professional and the terminal provides the user with video calling or chat functionality.

[1697] Input: Assigned medical professional, connection request

[1698] Output: Establishing a connection, calling and chatting with the user

[1699] Specific behavior:

[1700] The server establishes a connection with the medical professional and notifies the device.

[1701] The device will prompt the user to "Start a call with your doctor" and begin the video call or chat.

[1702] (Application example 1)

[1703] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1704] Truck drivers and logistics center staff work in harsh environments, and are required to perform their work safely and efficiently while managing their health. However, there is no system that comprehensively supports these tasks. Therefore, the challenge is to provide a system that integrates route optimization, health management, mental support, economical and healthy meal suggestions, real-time communication, and remote medical support.

[1705] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1706] In this invention, the server includes means for optimizing driving routes for truck drivers, means for acquiring and analyzing health data, means for providing mental support, means for suggesting economical and healthy meals, means for real-time communication with users, means for providing remote medical support, means for calculating and displaying optimal delivery routes within a logistics center, means for continuously transmitting health monitoring data to the server and generating alerts when an abnormality is detected, means for evaluating mental states and providing appropriate advice, means for collecting information on nearby restaurants and presenting economical and healthy meal options, and means for acquiring health data using wearable devices, thereby enabling comprehensive support for the working environment of truck drivers and logistics center staff and improving efficiency and safety.

[1707] "Route optimization means" is a method that uses real-time traffic information and map data to calculate and present routes so that trucks and logistics center vehicles can reach their destinations via the most optimal route.

[1708] The "health data acquisition means" is a means for periodically acquiring health data such as heart rate, number of steps, and sleep patterns from the sensor device and transmitting the data to the server.

[1709] The "mental support providing means" is a means for assessing the user's mental state, asking questions to provide appropriate advice and support, and analyzing the answers.

[1710] The "means for suggesting economical and healthy meals" is a means for collecting information on nearby restaurants based on the user's location and presenting economical and healthy meal options based on prices and menu contents.

[1711] "Means for real-time communication with users" refers to means for receiving and analyzing information input by users via voice or text, generating appropriate responses, and presenting them to the users.

[1712] A "telemedical support means" is a means that provides a real-time video call or chat function with a medical professional when a user feels unwell.

[1713] The "means for calculating and displaying the optimum delivery route within a logistics center" is a means for calculating and displaying the optimum route for movement within and around a logistics center.

[1714] "Means for continuously transmitting health monitoring data to a server and generating an alert when an abnormality is detected" refers to means for continuously transmitting health data collected from a wearable device to a server and generating an alert when an abnormality is detected.

[1715] The "means for evaluating a mental state and providing appropriate advice" is a means for presenting a user with questions for evaluating the user's mental state, analyzing the answers to the questions, and providing appropriate advice.

[1716] "Means for collecting information on nearby restaurants and presenting economical and healthy meal options" refers to means for collecting information on restaurants near the user's current location and suggesting economical and nutritionally balanced meals.

[1717] "Means for acquiring health data using a wearable device" refers to means for acquiring health data from a wearable device worn by a user.

[1718] The present invention is an integrated system for comprehensively supporting the working environment of truck drivers and staff in logistics centers. This system includes the following means.

[1719] Route optimization

[1720] The server receives departure and destination information from the device. The device uses a GPS module to obtain the user's current location. The server uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent back to the device and presented to the user visually and audibly, allowing the user to travel efficiently and safely.

[1721] health care

[1722] Wearable devices are used to collect health data such as heart rate, number of steps, and sleep patterns. The collected data is continuously sent to a server via the device. The server analyzes the received health data and generates an alert if an abnormality is detected, notifying the user via the device. This allows users to understand their own health condition in real time and take necessary measures.

[1723] Mental support

[1724] The device periodically displays questions to the user to assess their mental state. The user's answers are sent to a server, which analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive mental health care on a daily basis.

[1725] Economical and healthy meal suggestions

[1726] When a user wants to eat, they input a request into their device. The device obtains their current location and sends it to the server. The server uses the current location information to collect information about nearby restaurants and searches for prices, menus, and health options. The optimal meal options are generated and sent to the device. This allows users to easily choose economical and healthy meals.

[1727] Real-time communication

[1728] The device receives user input via voice or text and sends it to the server. The server analyzes the input, generates an appropriate response, and sends it to the device. The device then displays or plays the response to the user, allowing the user to receive the information or support they need in real time.

[1729] Telemedicine Support

[1730] When a user feels unwell, they request telemedicine services via their device. The request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established, the device provides real-time video calls or chat functionality, allowing the user and medical professional to communicate directly.

[1731] Examples:

[1732] For example, if a staff member at a logistics center wants to use the system to optimize a delivery route, they input the departure and destination into a terminal. The server calculates the optimal route in real time and displays it on the terminal. Staff can check the route information visually and audibly, allowing them to carry out delivery work efficiently. If any abnormalities in the staff's health are detected along the way, an alert will be displayed on the terminal and instructions on how to deal with the situation will be given. The system also supports staff health management by collecting information on nearby restaurants and suggesting healthy meal options.

[1733] Example prompt sentence:

[1734] "Health data monitoring involves periodically collecting the following health information: heart rate, steps taken, and sleep duration. Based on this information, generate an application code that will alert the user if there is an abnormality and provide necessary action or connection to a medical institution."

[1735] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1736] Step 1:

[1737] The device receives the departure point and destination information from the user. At this point, the device uses the GPS module to obtain the user's current location. The inputs are the departure point, destination information, and current location data, which are then sent to the server. Upon receiving this, the server uses real-time traffic information and map data to calculate the optimal route based on the input data.

[1738] Step 2:

[1739] The server uses a real-time traffic information API and a map database to calculate the optimal route from the current location to the destination. The calculated route data is sent to the device. The device receives this route data and provides it to the user visually and audibly. The user can use the displayed route information and audio guidance to efficiently reach their destination.

[1740] Step 3:

[1741] The terminal periodically acquires health data such as heart rate, number of steps, and sleep patterns from the wearable device. The acquired health data is continuously sent to the server. When the server receives the data, it analyzes it and checks for any abnormalities. If an abnormality is detected, the server generates an alert and notifies the user via the terminal. This allows the user to become aware of the abnormality early and take appropriate action.

[1742] Step 4:

[1743] The device periodically displays questions to the user to assess their mental state. The user answers the displayed questions, and the answer data is sent to the server. The server analyzes the data and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1744] Step 5:

[1745] When a user inputs a request into the device when they want to eat, the device obtains their current location and sends it to the server. The server uses the current location information to collect information about nearby restaurants and searches for prices, menu items, and healthy options. The optimal meal options are generated and sent to the device. The user can use the displayed information to select an economical and healthy meal.

[1746] Step 6:

[1747] The device receives voice or text input from the user and sends it to the server. The server analyzes the input and generates an appropriate response. The response is then sent to the device and presented to the user visually or audibly. This allows the user to obtain the information or support they need in real time.

[1748] Step 7:

[1749] When a user feels unwell, they request telemedicine services via their device. The request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established, the device provides real-time video calls or chat functionality, allowing the user and medical professional to communicate directly, resulting in prompt and appropriate medical support.

[1750] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1751] This invention combines an emotion engine that recognizes the user's emotions in an integrated AI concierge application system to contribute to improving the working environment of truck drivers. This system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. In addition, it monitors the user's emotional state in real time and optimizes various support options based on the results.

[1752] Route optimization

[1753] The device obtains the user's current location from the GPS module and prompts the user to input their starting and destination information. This information is sent to the server, which uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[1754] health care

[1755] The device periodically acquires health data such as heart rate, number of steps, and sleep patterns from the sensor device and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[1756] Mental support

[1757] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1758] Economical meal suggestions

[1759] When a user wants to eat, they input their request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants and searches for prices, menus, and health-conscious options. The server generates optimal meal options and sends them to the device. The user reviews the proposed options and selects one.

[1760] Real-time communication

[1761] The user inputs information by voice or text, which the device recognizes and sends to the server. The server analyzes the input and generates an appropriate response. The generated response is sent to the device and displayed or played aloud to the user. This allows the user to use the concierge function to obtain appropriate information and support in real time.

[1762] Telemedicine Support

[1763] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function, allowing the user and the medical professional to communicate directly. This process allows the user to receive prompt and accurate medical support.

[1764] Emotion engine integration

[1765] The system also integrates an emotion engine to recognize the user's emotional state in real time. The emotion engine analyzes voice and facial expression data to evaluate the user's current emotional state (e.g., stress, joy, anxiety). The emotion engine's data is fed back to each of the other support tools, and their functions are adjusted based on the user's emotional state.

[1766] Specific examples

[1767] For example, if a truck driver is feeling fatigued or stressed during a long drive, the emotion engine will detect this. As a result, the mental support tool will suggest more relaxing advice or a short break. The route optimization tool will calculate and present a less stressful route (e.g., a route with less traffic) to the user. Furthermore, if an abnormality is detected in the health data (e.g., a sudden increase in heart rate), the remote medical support tool will automatically assign a medical professional to quickly diagnose and treat the problem.

[1768] In this way, the present invention provides comprehensive support for the working environment and health of truck drivers, and by optimizing the support content using an emotion engine, it aims to improve efficiency, safety, and health.

[1769] The processing flow will be explained below.

[1770] Route optimization

[1771] Step 1:

[1772] The terminal obtains the user's current location from the GPS module.

[1773] Step 2:

[1774] The terminal prompts the user to input the starting point and destination, which are then transmitted to the server.

[1775] Step 3:

[1776] The server obtains real-time traffic information via a communication network.

[1777] Step 4:

[1778] The server uses the acquired traffic information and map data to calculate the optimal route.

[1779] Step 5:

[1780] The server transmits the calculated route information to the terminal.

[1781] Step 6:

[1782] The terminal displays the received route information to the user and starts voice navigation.

[1783] Step 7:

[1784] The user follows the instructions on the terminal and starts driving along the route.

[1785] health care

[1786] Step 1:

[1787] The device periodically collects the user's health data (heart rate, number of steps, sleep patterns, etc.) from the sensor device.

[1788] Step 2:

[1789] The device transmits the acquired health data to a server.

[1790] Step 3:

[1791] The server analyzes the received health data and evaluates the user's health condition.

[1792] Step 4:

[1793] If the server detects an anomaly, it generates an alert.

[1794] Step 5:

[1795] The server sends the generated alert to the terminal.

[1796] Step 6:

[1797] The terminal receives the alert and notifies the user.

[1798] Step 7:

[1799] The user checks the notification and takes the necessary action.

[1800] Mental support

[1801] Step 1:

[1802] The terminal periodically displays questions to the user to assess their psychological state.

[1803] Step 2:

[1804] The user answers the questions and enters the answers into the terminal.

[1805] Step 3:

[1806] The terminal transmits the user's answer to the server.

[1807] Step 4:

[1808] The server analyzes the user's response data and evaluates their mental state.

[1809] Step 5:

[1810] The server generates appropriate advice based on the analysis results.

[1811] Step 6:

[1812] The server transmits the generated advice to the terminal.

[1813] Step 7:

[1814] The terminal displays the advice to the user and provides instructions.

[1815] Step 8:

[1816] The user confirms and implements the advice.

[1817] Economical meal suggestions

[1818] Step 1:

[1819] The user inputs a request into the terminal when they want to eat.

[1820] Step 2:

[1821] The terminal obtains the user's current location and transmits it to the server.

[1822] Step 3:

[1823] The server collects information about nearby restaurants based on the current location information.

[1824] Step 4:

[1825] The server analyzes the collected restaurant menus, prices, and health options.

[1826] Step 5:

[1827] The server generates optimal meal options and sends them to the device.

[1828] Step 6:

[1829] The terminal displays suggested restaurants and menus to the user.

[1830] Step 7:

[1831] The user selects and visits the suggested restaurant.

[1832] Real-time communication

[1833] Step 1:

[1834] The user inputs information into the terminal by voice or text.

[1835] Step 2:

[1836] The terminal recognizes the input and sends it to the server.

[1837] Step 3:

[1838] The server parses the input and generates an appropriate response.

[1839] Step 4:

[1840] The server generates a response and sends it to the terminal.

[1841] Step 5:

[1842] The terminal displays or plays the response aloud to the user.

[1843] Step 6:

[1844] Users can obtain information while enjoying interacting with the terminal.

[1845] Telemedicine Support

[1846] Step 1:

[1847] When a user feels unwell, the user inputs a request for remote medical services from the terminal.

[1848] Step 2:

[1849] The terminal sends a request to the server.

[1850] Step 3:

[1851] The server receives the request and assigns the appropriate medical professional.

[1852] Step 4:

[1853] The server establishes a connection with the medical professional and notifies the terminal.

[1854] Step 5:

[1855] The device provides real-time video calling or chat functionality to facilitate communication between users and medical professionals.

[1856] Step 6:

[1857] A medical professional will review the user's symptoms and provide a diagnosis and advice.

[1858] Step 7:

[1859] The device displays the medical professional's diagnosis and advice to the user.

[1860] Step 8:

[1861] The user takes action according to the advice provided.

[1862] Emotion engine integration

[1863] Step 1:

[1864] The terminal acquires the user's voice and facial expression data from a camera and microphone.

[1865] Step 2:

[1866] The terminal transmits the acquired data to the server.

[1867] Step 3:

[1868] The server analyzes the voice data and facial expression data to assess the user's emotional state.

[1869] Step 4:

[1870] The server sends feedback to the mental support means and the travel route optimization means based on the emotional state.

[1871] Step 5:

[1872] The server generates advice and a less stressful route according to the user's emotional state.

[1873] Step 6:

[1874] The server transmits the generated content to the terminal.

[1875] Step 7:

[1876] The device displays appropriate advice and routes to the user based on their emotional state.

[1877] Specific examples

[1878] For example, if a truck driver begins to feel tired after a long drive, the emotion engine will detect this emotion and analyze the driver's voice and facial expression data during the drive. As a result, the server will enhance mental support measures, suggesting relaxation advice and short breaks. In addition, the route optimization tool will recalculate a route with better road conditions to reduce stress and notify the user. Furthermore, if an abnormality is detected in the user's health data, the system will respond quickly and enable remote medical support. This will improve the overall health and mental state of truck drivers.

[1879] Example 2

[1880] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1881] Conventional truck driver systems provide separate functions for route optimization, health management, mental support, meal suggestions, real-time communication, and remote medical support, and the functions are not well integrated. In particular, the user's emotional state is not reflected in real time, making it difficult to receive optimal support. Furthermore, data sharing between different devices and platforms is not smooth, creating a need for a system that truck drivers can use effectively.

[1882] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1883] In this invention, the server includes a means for optimizing a driving route, a means for acquiring and analyzing health data, a means for providing mental support, a means for suggesting economical and healthy meals, a means for real-time communication with a user, a means for providing remote medical support, and a means for recognizing the user's emotional state and providing feedback to the other means. This allows truck drivers to receive integrated support in real time that is linked between different functions, enabling optimal support that takes into account the user's emotional state.

[1884] "User" refers to the entity that uses this system, specifically truck drivers.

[1885] "Server" refers to a central control device that manages data, analyzes it, generates responses, and other processes.

[1886] A "terminal" is a device used by a user, such as a smartphone or tablet, that communicates with a server.

[1887] "Route optimization means" refers to a function that calculates the optimal route using real-time traffic information and map data based on the departure point and destination specified by the user.

[1888] "Health data acquisition means" refers to a function that acquires health data such as the user's heart rate, number of steps, and sleep patterns from the sensor device and transmits that data to a server.

[1889] "Mental support means" refers to a function that evaluates the user's psychological state and provides appropriate advice and care.

[1890] "Economical and healthy meal suggestion means" refers to a function that collects information on nearby restaurants based on the user's current location and suggests meal options that take price and health into consideration.

[1891] "Real-time communication means" refers to functionality that allows for the immediate exchange of information between the user and the system, and is done through voice input or text input.

[1892] "Telemedical support means" refers to a function that allows users to remotely access specialists when they are unwell and receive diagnosis and treatment.

[1893] "Emotion engine" refers to a system that analyzes a user's voice data and facial expression data to recognize the user's emotional state in real time.

[1894] This invention combines an emotion engine that recognizes the user's emotions in an integrated AI concierge application system to contribute to improving the working environment of truck drivers. This system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. In addition, it monitors the user's emotional state in real time and optimizes various support options based on the results.

[1895] Route optimization

[1896] The device uses a GPS module to obtain the user's current location and prompts the user to input starting and destination information. This information is sent to a server, which uses real-time traffic information and map data (e.g., Google Maps API) to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing the user to confirm route information both visually and audibly.

[1897] health care

[1898] The device periodically obtains health data such as heart rate, number of steps, and sleep patterns from sensor devices (e.g., Fitbit, Apple Watch) and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[1899] Mental support

[1900] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers (e.g., Google Cloud NLP API) and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[1901] Economical meal suggestions

[1902] When a user wants to eat, they input a request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants (e.g., Yelp API, Google Places API) and searches for prices, menus, and health-conscious options. The optimal meal options are generated and sent to the device. The user reviews the proposed options and selects one.

[1903] Real-time communication

[1904] The user inputs information via voice or text, which the device recognizes and sends to the server. The server analyzes the input (e.g., Google Cloud NLP API) and generates an appropriate response. The response is then sent to the device and displayed or played aloud to the user. This allows the user to utilize the concierge function to receive appropriate information and support in real time.

[1905] Telemedicine Support

[1906] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function (e.g., Zoom API, Microsoft Teams API) for direct communication between the user and the medical professional. This process allows the user to receive prompt and accurate medical support.

[1907] Emotion engine integration

[1908] The system also integrates an emotion engine to recognize the user's emotional state in real time. The emotion engine analyzes voice and facial expression data to evaluate the user's current emotional state (e.g., stress, joy, anxiety). The emotion engine's data is fed back to each of the other support tools, and their functions are adjusted based on the user's emotional state.

[1909] Specific examples

[1910] For example, if a truck driver is feeling fatigued or stressed during a long drive, the emotion engine will detect this. As a result, the mental support tool will suggest more relaxing advice or a short break. The route optimization tool will calculate and present a less stressful route (e.g., a route with less traffic) to the user. Furthermore, if an abnormality is detected in the health data (e.g., a sudden increase in heart rate), the remote medical support tool will automatically assign a medical professional to quickly diagnose and treat the problem.

[1911] Prompt Sentence Examples

[1912] "Can you please tell me a simple program that evaluates the user's emotional state and optimizes the route accordingly?"

[1913] "Can you give us an example of a program that suggests nearby healthy food options based on the user's current location?"

[1914] "How can we assess a user's emotional state in real time and provide appropriate advice?"

[1915] In this way, the present invention provides comprehensive support for the working environment and health of truck drivers, and by optimizing the support content using an emotion engine, it aims to improve efficiency, safety, and health.

[1916] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1917] Route optimization

[1918] Step 1: User enters start and destination

[1919] The user inputs the starting point and destination information into the terminal, and this data is sent to the server in text format.

[1920] Step 2: The device obtains its current location

[1921] The device uses a built-in GPS module to obtain the user's current location in real time, and this location information (latitude and longitude) is sent to the server.

[1922] Step 3: The device sends the data to the server

[1923] The device transmits the starting point, destination, and current location to the server. The transmitted data includes location information, and the server analyzes the data based on that information.

[1924] Step 4: The server calculates the optimal route

[1925] The server uses the received departure point, destination, and current location information to reference real-time traffic information and map data (e.g., Google Maps API), and calculates the optimal route. The calculation results are generated in JSON format.

[1926] Step 5: The server sends the calculation results to the terminal

[1927] The server then sends the calculated optimal route data to the device, including detailed directions and estimated arrival times.

[1928] Step 6: The device displays the route information to the user.

[1929] The device then displays the received optimal route information to the user, and voice navigation begins along with the visual map display.

[1930] health care

[1931] Step 1: The device acquires data from the sensor device

[1932] The device collects health data such as heart rate, steps, and sleep patterns from sensor devices (e.g., Fitbit, Apple Watch) via Bluetooth or Wi-Fi.

[1933] Step 2: The device sends the health data to the server

[1934] The device periodically transmits the acquired health data, including heart rate, number of steps, and sleep data, to a server.

[1935] Step 3: The server analyzes the data

[1936] The server uses the received health data to analyze it using Python libraries such as Pandas and NumPy, assessing the user's health status and calculating the average and standard deviation.

[1937] Step 4: The server detects an anomaly

[1938] Based on the analysis results, the server generates an alert if an abnormal value exceeding the set threshold is detected.

[1939] Step 5: The device notifies the user of the alert

[1940] The device receives alerts from the server and notifies the user, including advice on how to deal with abnormal health conditions and suggestions for consulting a medical institution.

[1941] Mental support

[1942] Step 1: The device displays questions to assess your emotional state

[1943] The device periodically displays questions to the user to assess their psychological state (e.g., "How are you feeling today?").

[1944] Step 2: User answers questions

[1945] The user inputs answers to the displayed questions, and the input data is sent to the terminal in text format.

[1946] Step 3: The device sends the answer to the server

[1947] The terminal transmits the user's answer data to the server, which includes the question and the corresponding user's answer.

[1948] Step 4: The server parses the answer

[1949] The server analyzes the received answers using text analysis (e.g., Google Cloud NLP API) and evaluates the user's mental state.

[1950] Step 5: Server generates advice

[1951] The server generates appropriate advice based on the analysis results, including methods for relaxation and stress relief. The generated results are output in JSON format.

[1952] Step 6: The device provides advice to the user

[1953] The terminal displays the advice received from the server to the user, using diagrams and text.

[1954] Economical meal suggestions

[1955] Step 1: User enters meal request

[1956] The user inputs a request into the device when they want to eat, and the input data is saved in text format.

[1957] Step 2: The device obtains its current location

[1958] The device uses the built-in GPS module to obtain the user's current location, and the location data is sent to the server in latitude and longitude format.

[1959] Step 3: The device sends a request to the server

[1960] The terminal transmits its current location and a request to the server. The transmitted data includes the user's desired content.

[1961] Step 4: Server collects restaurant information

[1962] The server collects information about nearby restaurants using APIs (e.g., Yelp API, Google Places API). The collected data includes restaurant names, menus, and price information.

[1963] Step 5: The server makes a recommendation based on the criteria.

[1964] The server analyzes the collected data and generates optimal dining options based on price, menu, and health-conscious options, outputting the recommendation results in JSON format.

[1965] Step 6: Your device will display meal options

[1966] The terminal displays the meal options received from the server to the user, who can then review the suggested options and select the meal of their choice.

[1967] Real-time communication

[1968] Step 1: User provides voice or text input

[1969] Users input questions or requests into the device by voice or text, and the voice data is converted into text (e.g., Google Speech-to-Text API).

[1970] Step 2: The device sends the input data to the server

[1971] The device sends voice and text input data to the server, including the user's question.

[1972] Step 3: The server parses the input

[1973] The server parses the received input data (e.g., Google Cloud NLP API) and generates an appropriate response, which is created using a generative AI model.

[1974] Step 4: Server generates response

[1975] The server uses a generative AI model (e.g., OpenAI's GPT-4) to create an appropriate response and outputs it in JSON format.

[1976] Step 5: The device displays or plays a response to the user

[1977] The terminal displays or plays a response received from the server to the user, using text and audio for display.

[1978] Telemedicine Support

[1979] Step 1: User enters telehealth request

[1980] Users input remote medical care requests into the terminal when they feel unwell, and the request data is recorded in text format.

[1981] Step 2: The device sends a request to the server

[1982] The terminal transmits request data to the server, which includes information about the user's poor physical condition.

[1983] Step 3: The server assigns a medical professional

[1984] The server assigns the appropriate medical professional based on the received request, and the assignment result is output in JSON format.

[1985] Step 4: Connect your device to a medical professional

[1986] The device provides real-time video calling or chat functionality for direct communication between users and medical professionals. Video calling uses APIs (e.g., Zoom API, Microsoft Teams API).

[1987] Step 5: Providing medical support

[1988] Medical professionals provide users with diagnoses and treatments, which are communicated to them in real time.

[1989] Emotion engine integration

[1990] Step 1: The device acquires voice and facial expression data

[1991] The device uses a camera and microphone to capture the user's voice and facial expression data, which is collected in real time.

[1992] Step 2: The device sends the data to the server

[1993] The device transmits the acquired voice data and facial expression data to the server. The transmitted data includes voice files and image data.

[1994] Step 3: The server evaluates the emotional state

[1995] The server uses an emotion engine to analyze the voice and facial expression data and evaluate the user's emotional state, outputting the evaluation results in JSON format.

[1996] Step 4: The server feeds the results back to each support function

[1997] The server then provides feedback to each of the other support functions based on the analysis results, adjusting each function based on the user's emotional state. The feedback data includes recommended actions.

[1998] (Application example 2)

[1999] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2000] The logistics industry is required to improve employee operational efficiency while also providing integrated health and mental health care. However, in current systems, these elements exist independently, making it difficult to provide consistent support. Furthermore, there is no adequate system in place to recognize employees' emotional states in real time and provide optimal support based on that information. This results in insufficient improvements to the working environment and adaptive support for individual employees.

[2001] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for optimizing a travel route, a means for acquiring and analyzing health data, a means for providing mental support, a means for suggesting economical and healthy meals, a means for communicating with the user in real time, a means for providing remote medical support, and an emotion engine that recognizes the user's emotions and optimizes various functions. This makes it possible to comprehensively support the working environment and health of logistics industry workers and provide optimal support according to their emotional state.

[2002] The "logistics industry" refers to the industry that systematically transports, stores, and delivers goods.

[2003] "Employee" means a person engaged in a particular job or activity.

[2004] A "route" is a means of transportation or a route from a specific point to a destination.

[2005] "Optimization" refers to achieving the best possible state under specific conditions.

[2006] "Health Data" means information that describes a person's physical health, such as heart rate, number of steps taken, and sleep patterns.

[2007] "Mental support" refers to the provision of psychological advice and assistance.

[2008] "Dietary suggestions" refers to providing information about food to encourage better choices.

[2009] "Real-time communication" refers to the instantaneous exchange of information at the same time.

[2010] "Telehealth support" refers to the provision of medical-related assistance or services from a physically distant location.

[2011] An "emotion engine" is a system or algorithm that analyzes a user's emotional state and responds appropriately based on that information.

[2012] A "server" is a computer system that provides services to clients over a network.

[2013] This invention is an integrated AI concierge application system for logistics industry professionals. The system provides route optimization, health management, mental support, economical and healthy meal suggestions, real-time communication, remote medical support, and various support optimization functions using an emotion engine.

[2014] The server includes the following means:

[2015] 1. Route optimization measures:

[2016] The server calculates the optimal route based on the user's current location obtained from the GPS module and the destination information entered by the user, using real-time traffic information and map data. The results of this calculation are sent to the device and displayed. In addition, voice navigation is provided, allowing the user to confirm route information both visually and audibly.

[2017] 2. Health management measures:

[2018] The server periodically collects and analyzes health data such as heart rate, step count, and sleep patterns from the sensor device. If an abnormality is detected, an alert is generated and notified to the user via the device, allowing the user to take prompt action.

[2019] 3. Mental support measures:

[2020] The server analyzes the user's answers to questions displayed on the device to assess their psychological state. Based on the analysis results, it generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[2021] 4. Economical and healthy meal suggestions:

[2022] The server receives a request from the user when they want to eat, obtains their current location, and then searches for nearby restaurants based on price, menu, and health-conscious options. Based on this information, it generates optimal meal options and sends them to the user.

[2023] 5. Real-time communication methods:

[2024] The server analyzes the user's voice or text input and generates an appropriate response, which is sent to the device and displayed or played aloud to the user, providing instant information or assistance.

[2025] 6. Telemedicine support methods:

[2026] The server allows users to request telemedicine services via their device when they feel unwell. The server then assigns an appropriate medical professional to the user. Once a connection with the medical professional is established, the device provides real-time video calls and chat functions.

[2027] 7. Emotion Engine:

[2028] The server analyzes the voice data and facial expression data to recognize the user's emotional state in real time. The data analyzed by the emotion engine is fed back to each of the other support means, and the support provided is adjusted based on the user's emotional state.

[2029] Specific examples

[2030] For example, if an employee working in a logistics center wearing smart glasses feels fatigued after working for a long time, the emotion engine will detect this and provide mental support, suggesting relaxation advice or a short break, while the route optimization tool will calculate a less stressful route and change work instructions.

[2031] Prompt Sentence Examples

[2032] "We are developing an integrated AI concierge application system for employees working in logistics centers to improve their working environment. The system combines an emotion engine that recognizes the user's emotions and provides the following functions: route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support. This system uses smartphones, smart glasses, and head-mounted displays. Please explain in detail how the system processes data and achieves each function."

[2033] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2034] Step 1:

[2035] When a user wants to optimize their route, they input their current location and destination into the device. This information is acquired using a GPS module and sent to the server. The server uses real-time traffic information and map data to calculate the optimal route based on this input and sends the results to the device. The device then displays the calculation results and provides voice navigation.

[2036] Step 2:

[2037] The device collects data from sensor devices so that users can regularly monitor their health data, such as heart rate, steps, and sleep patterns. This data is then sent to a server where it is analyzed. If an abnormal value is detected, the server generates an alert and sends a notification to the user via the device. The user can then take appropriate action based on the alert content.

[2038] Step 3:

[2039] The device periodically displays questions to the user to assess their psychological state. The data the user answers is sent to a server, where natural language analysis is performed. Based on the analysis results, the server generates appropriate mental support advice and sends it to the device. The user can then review this advice and receive mental health care.

[2040] Step 4:

[2041] When a user wants to eat, they input a request into their device. The device obtains their current location information and sends it to the server. The server then collects information about nearby restaurants based on their current location and searches for prices, menus, and health-conscious options. The best meal options are generated and sent back to the device. The user can review this information and make a selection.

[2042] Step 5:

[2043] When a user inputs something using voice or text, the device recognizes it and sends it to the server. The server analyzes the input and generates an appropriate response. The response is then sent to the device and displayed to the user or played aloud, allowing the user to instantly access the information or support they need.

[2044] Step 6:

[2045] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established with the medical professional, the device provides real-time video calls and chat functions, allowing the user to communicate directly with the professional.

[2046] Step 7:

[2047] The device captures voice and facial expression data using a camera and microphone and sends it to a server. The server then uses an emotion recognition algorithm to analyze the user's emotional state and feeds the analysis results back to other devices. The support provided is adjusted based on the emotional data.

[2048] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2049] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2050] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2051] [Fourth embodiment]

[2052] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2053] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2054] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2055] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2056] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2057] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2058] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2059] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2060] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2061] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2062] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2063] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2064] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2065] This invention is an integrated AI concierge application system to contribute to improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[2066] Route optimization

[2067] The device obtains the user's current location from the GPS module and prompts the user to input their starting and destination information. This information is sent to the server, which uses real-time traffic information and map data to calculate the optimal route. The calculation results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[2068] health care

[2069] The device periodically acquires health data such as heart rate, number of steps, and sleep patterns from the sensor device and sends it to a server. The server analyzes the received health data and evaluates the user's health condition. If an abnormality is detected, the server generates an alert and notifies the user via the device. The alert includes suggestions for how to deal with the problem or to consult a medical institution.

[2070] Mental support

[2071] The device periodically displays questions to the user to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device. This allows the user to receive daily mental health care.

[2072] Economical meal suggestions

[2073] When a user wants to eat, they input their request into their device, and the device obtains their current location. The server uses the current location information to gather information about nearby restaurants and searches for prices, menus, and health-conscious options. The server generates optimal meal options and sends them to the device. The user reviews the proposed options and selects one.

[2074] Real-time communication

[2075] The user inputs information by voice or text, which the device recognizes and sends to the server. The server analyzes the input and generates an appropriate response. The generated response is sent to the device and displayed or played aloud to the user. This allows the user to use the concierge function to obtain appropriate information and support in real time.

[2076] Telemedicine Support

[2077] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection with the medical professional is established, the device provides a real-time video call or chat function, allowing the user and the medical professional to communicate directly. This process allows the user to receive prompt and accurate medical support.

[2078] Specific examples

[2079] For example, when a truck driver departs from a warehouse in a city to head to a distant delivery destination, he or she inputs the destination into the device before setting off. The server calculates the optimal route in real time and displays it on the device. While driving, the device regularly monitors the driver's heart rate and number of steps, and if an abnormality is detected, the server generates an alert and notifies the user. Furthermore, when the driver wants to eat during a delivery, the driver sends a request from the device, and the server searches for nearby restaurants and suggests the best meal options. Furthermore, if the driver feels tired or stressed after a long drive, they can use the device's conversation function to receive mental support.

[2080] In this way, the present invention provides a system that can comprehensively support the working environment and health of truck drivers and improve their efficiency and safety.

[2081] The processing flow will be explained below.

[2082] Route optimization

[2083] Step 1:

[2084] The device obtains the user's current location from the GPS module.

[2085] Step 2:

[2086] The terminal prompts the user to input the starting point and destination, which are then transmitted to the server.

[2087] Step 3:

[2088] The server obtains real-time traffic information via a communication network.

[2089] Step 4:

[2090] The server uses the acquired traffic information and map data to calculate the optimal route.

[2091] Step 5:

[2092] The server transmits the calculated route information to the terminal.

[2093] Step 6:

[2094] The terminal displays the received route information to the user and starts voice navigation.

[2095] Step 7:

[2096] The user follows the instructions on the terminal and starts driving along the route.

[2097] health care

[2098] Step 1:

[2099] The device periodically collects the user's health data (heart rate, number of steps, sleep patterns, etc.) from the sensor device.

[2100] Step 2:

[2101] The device transmits the acquired health data to a server.

[2102] Step 3:

[2103] The server analyzes the received health data and evaluates the user's health condition.

[2104] Step 4:

[2105] If the server detects an anomaly, it generates an alert.

[2106] Step 5:

[2107] The server sends the generated alert to the terminal.

[2108] Step 6:

[2109] The terminal receives the alert and notifies the user.

[2110] Step 7:

[2111] The user checks the notification and takes the necessary action.

[2112] Mental support

[2113] Step 1:

[2114] The terminal periodically displays questions to the user to assess their psychological state.

[2115] Step 2:

[2116] The user answers the questions and enters the answers into the terminal.

[2117] Step 3:

[2118] The terminal transmits the user's answer to the server.

[2119] Step 4:

[2120] The server analyzes the user's response data and evaluates their mental state.

[2121] Step 5:

[2122] The server generates appropriate advice based on the analysis results.

[2123] Step 6:

[2124] The server transmits the generated advice to the terminal.

[2125] Step 7:

[2126] The terminal displays the advice to the user and provides instructions.

[2127] Step 8:

[2128] The user confirms and implements the advice.

[2129] Economical meal suggestions

[2130] Step 1:

[2131] The user inputs a request into the terminal when they want to eat.

[2132] Step 2:

[2133] The terminal obtains the user's current location and transmits it to the server.

[2134] Step 3:

[2135] The server collects information about nearby restaurants based on the current location information.

[2136] Step 4:

[2137] The server analyzes the collected restaurant menus, prices, and health options.

[2138] Step 5:

[2139] The server generates optimal meal options and sends them to the device.

[2140] Step 6:

[2141] The terminal displays suggested restaurants and menus to the user.

[2142] Step 7:

[2143] The user selects and visits the suggested restaurant.

[2144] Real-time communication

[2145] Step 1:

[2146] The user inputs information into the terminal by voice or text.

[2147] Step 2:

[2148] The terminal recognizes the input and sends it to the server.

[2149] Step 3:

[2150] The server parses the input and generates an appropriate response.

[2151] Step 4:

[2152] The server generates a response and sends it to the terminal.

[2153] Step 5:

[2154] The terminal displays or plays the response aloud to the user.

[2155] Step 6:

[2156] Users can obtain information while enjoying interacting with the terminal.

[2157] Telemedicine Support

[2158] Step 1:

[2159] When a user feels unwell, the user inputs a request for remote medical services from the terminal.

[2160] Step 2:

[2161] The terminal sends a request to the server.

[2162] Step 3:

[2163] The server receives the request and assigns the appropriate medical professional.

[2164] Step 4:

[2165] The server establishes a connection with the medical professional and notifies the terminal.

[2166] Step 5:

[2167] The device provides real-time video calling or chat functionality to facilitate communication between users and medical professionals.

[2168] Step 6:

[2169] A medical professional will review the user's symptoms and provide a diagnosis and advice.

[2170] Step 7:

[2171] The device displays the medical professional's diagnosis and advice to the user.

[2172] Step 8:

[2173] The user takes action according to the advice provided.

[2174] Example 1

[2175] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2176] Truck drivers often drive long hours and work in harsh environments. This requires efficient and safe routes, health management and mental support, a balanced diet, and prompt medical support. However, no system has previously existed that provides all of these services in an integrated manner. As a result, drivers are often exposed to the risk of overwork, stress, unhealthy eating, and delays and accidents due to inappropriate driving routes. A comprehensive system to solve these issues is needed.

[2177] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2178] In this invention, the server includes means for acquiring a current location, means for inputting and transmitting start and destination information, means for calculating an optimal driving route using real-time traffic information and map data, means for periodically acquiring and transmitting health data, means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected, means for displaying questions to assess a driver's mental state, acquiring and transmitting answers, means for analyzing the answers to evaluate the driver's mental state and generating appropriate advice, means for inputting a meal request and acquiring current location information, means for collecting information on nearby restaurants and searching for prices, menus, and health-conscious options, means for recognizing and analyzing voice or text input, means for requesting remote medical services and assigning an appropriate medical professional, and means for connecting with the medical professional and providing a video call or chat function. This allows drivers to receive multiple necessary services, such as efficient driving routes, health management, mental support, provision of balanced meals, and prompt remote medical support, all in one place.

[2179] The "means for acquiring the current location" is a device including a GPS module and a sensor device used to acquire the user's location information.

[2180] The "means for inputting and transmitting information on the starting point and destination" refers to an interface and communication means for the user to input the starting point and destination and transmit that information to the server.

[2181] "Means for calculating optimal driving routes using real-time traffic information and map data" refers to a system that includes an algorithm and database for obtaining traffic conditions and map data in real time and calculating optimal driving routes based on that information.

[2182] The "means for periodically acquiring and transmitting health data" is a device that includes communication means for periodically acquiring a user's health data from a sensor device and transmitting that data to a server.

[2183] The "means for analyzing and evaluating the received health data and generating an alert if an abnormality is detected" refers to software and algorithms that allow the server to analyze the user's health data received and generate and notify an alert if an abnormality is detected.

[2184] The "means for displaying questions to evaluate the psychological state and acquiring and transmitting answers" refers to an interface and communication means for displaying questions to evaluate the user's psychological state on a terminal, acquiring the user's answers, and transmitting them to a server.

[2185] The "means for analyzing the answers, assessing the mental state, and generating appropriate advice" refers to software and algorithms that allow the server to analyze the user's answers, assess the mental state, and generate appropriate advice based on the results.

[2186] The "means for inputting a meal request and obtaining current location information" is a device that includes an interface and a GPS module for a user to input a meal request and obtain current location information at that time.

[2187] "Means for collecting information about nearby restaurants and searching for prices, menus, and health-conscious options" refers to software and a database for collecting information about nearby restaurants based on the user's current location information and searching for prices, menus, and health-conscious options.

[2188] "Means for recognizing and analyzing voice or text input" refers to language processing algorithms and software for recognizing a user's voice or text input and analyzing its content.

[2189] "Means for requesting telehealth services and assigning appropriate medical professionals" refers to systems and software for accepting a user's request for telehealth services and selecting and assigning an appropriate medical professional based on the request.

[2190] "Means for connecting with medical professionals and providing video call or chat functionality" refers to an interface and communication means for users and medical professionals to communicate in real time via video call or chat.

[2191] This invention is an integrated AI concierge application system for comprehensively improving the working environment of truck drivers. The system provides route optimization, health management, mental support, economical meal suggestions, real-time communication, and remote medical support.

[2192] Route optimization

[2193] The device uses a GPS module to obtain the user's current location and prompts the user to input their starting and destination information. This information is sent to a server, which uses real-time traffic information and map data to calculate the optimal route. The results are sent to the device and displayed to the user. Voice navigation is also provided, allowing users to confirm route information both visually and audibly.

[2194] As a concrete example, if a user inputs starting point A and destination B, the server will use real-time traffic information and map data (e.g., Google Maps API) to calculate the optimal route and display a notification on the device such as "Highway Route 1 is the shortest."

[2195] Example prompt sentence:

[2196] "Calculate the best route from point A to point B."

[2197] health care

[2198] The device periodically acquires health data such as heart rate, step count, and sleep patterns from a sensor device (e.g., Fitbit) and sends it to a server. The server analyzes the received health data and evaluates the user's health status. If an abnormality is detected, the server generates an alert and notifies the user via the device.

[2199] As a specific example, if a user's heart rate shows abnormalities, the server generates an alert such as "Your heart rate is dropping. Please consult a medical institution" and notifies the device.

[2200] Example prompt sentence:

[2201] "Generate a notification message if an abnormal heart rate is detected."

[2202] Mental support

[2203] The device periodically asks the user questions to assess their mental state and sends the user's answers to the server. The server analyzes the answers and evaluates the user's mental state. Based on the analysis results, the server generates appropriate advice and provides it to the user via the device.

[2204] For example, if a user types, "I've been feeling tired lately. What should I do?", the server will respond with advice such as, "Try taking some deep breaths to relax."

[2205] Example prompt sentence:

[2206] "Please suggest ways for users who have been feeling tired recently to relax."

[2207] Economical meal suggestions

[2208] When a user wants to eat, they input their request into their device, which then acquires their current location. The server uses this location information to gather information about nearby restaurants, searching for prices, menus, and health-conscious options. The best meal options are then sent to the device and displayed to the user.

[2209] For example, if a user types, "Tell me where I can get a cheap, healthy meal nearby," the server will notify the device of the result, such as, "XYZ Restaurant, salads for 550 yen."

[2210] Example prompt sentence:

[2211] "Suggest economical and healthy food options near the user's current location."

[2212] Real-time communication

[2213] The user provides input via voice or text, which the device recognizes and sends to the server, which analyzes the input and generates an appropriate response, which is then sent to the device and displayed or played aloud to the user.

[2214] As a specific example, if a user voice-inputs "What's the weather going to be like tomorrow?", the server retrieves information from a weather forecast service (e.g., the OpenWeather API) and generates a response such as "It's going to be sunny tomorrow."

[2215] Example prompt sentence:

[2216] "Please tell me the weather forecast for tomorrow."

[2217] Telemedicine Support

[2218] When a user feels unwell, they request telemedicine services via their device. This request is sent to the server, which then assigns an appropriate medical professional. Once a connection is established with the medical professional, the device provides real-time video calls or chat functionality, allowing the user and the medical professional to communicate directly.

[2219] For example, if a user inputs "I have a persistent headache and would like to speak to a doctor," the server will assign a medical professional and start a video call. The medical professional will communicate with the user by asking them to explain their symptoms in detail.

[2220] Example prompt sentence:

[2221] "Generate initial diagnostic questions for users suffering from headaches."

[2222] In this way, the integrated AI concierge application system of the present invention is a system that can comprehensively support the working environment and health of truck drivers, and improve efficiency and safety.

[2223] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2224] Route optimization

[2225] Step 1:

[2226] The terminal uses a GPS module to obtain the user's current location.

[2227] Input: Location information from GPS module

[2228] Output: Current location (e.g., latitude 34.0522, longitude -118.2437)

[2229] Specific behavior:

[2230] The device obtains its current location information of "latitude 34.0522, longitude -118.2437".

[2231] Step 2:

[2232] The user inputs the departure point and destination information into the terminal.

[2233] Input: Departure point and destination information (e.g., point A and point B)

[2234] Output: User input data

[2235] Specific behavior:

[2236] The user inputs "starting point A" and "destination B" into the terminal.

[2237] Step 3:

[2238] The terminal transmits the acquired current location, departure point, and destination information to the server.

[2239] Input: current location, starting point, destination information

[2240] Output: Data sent to the server

[2241] Specific behavior:

[2242] The device sends the data "starting point A, destination B, current location (latitude 34.0522, longitude -118.2437)" to the server.

[2243] Step 4:

[2244] The server uses real-time traffic information and map data to calculate the optimal route.

[2245] Input: Data sent to the server, traffic information, map data

[2246] Output: Optimal route

[2247] Specific behavior:

[2248] The server uses the Google Maps API to request the "shortest route from starting point A to destination B" and calculates the optimal route.

[2249] Step 5:

[2250] The server sends the calculation results to the terminal, which displays the results to the user.

[2251] Input: Optimal route

[2252] Output: Data displayed to the user

[2253] Specific behavior:

[2254] The server sends route information to the terminal stating, "Route 1 using the expressway is the shortest route."

[2255] The device displays the route on the screen and provides voice guidance.

[2256] health care

[2257] Step 1:

[2258] The device periodically collects health data such as heart rate, steps taken, and sleep patterns from sensor devices.

[2259] Input: Health data from sensor devices

[2260] Output: Retrieved health data

[2261] Specific behavior:

[2262] The device receives the following data from Fitbit: Heart rate: 72 bpm, Steps: 3000, Sleep time: 7 hours.

[2263] Step 2:

[2264] The device transmits the acquired health data to a server.

[2265] Input: Acquired health data

[2266] Output: Data sent to the server

[2267] Specific behavior:

[2268] The device sends the following data to the server: heart rate: 72 bpm, steps: 3000, sleep time: 7 hours.

[2269] Step 3:

[2270] The server analyzes the received health data and evaluates the user's health condition.

[2271] Input: Health data sent to the server

[2272] Output: Health status assessment results

[2273] Specific behavior:

[2274] The server analyzes the received data and evaluates it as follows: "A heart rate of 72 bpm is normal, 3,000 steps is half the recommended number, and 7 hours of sleep is sufficient."

[2275] Step 4:

[2276] If an abnormality is detected, the server generates an alert and notifies the user via their terminal.

[2277] Input: Health status assessment results

[2278] Output: Alert

[2279] Specific behavior:

[2280] The server generates an alert saying, "Your step count is low, so walk more," and sends it to the device.

[2281] The device will display an alert to the user and notify them via audio.

[2282] Mental support

[2283] Step 1:

[2284] The terminal periodically displays questions to the user to assess their psychological state and obtains the user's answers.

[2285] Input: User's answer

[2286] Output: The answer obtained

[2287] Specific behavior:

[2288] The device displays the question "Have you been feeling stressed lately?" and the user answers "Yes."

[2289] Step 2:

[2290] The terminal transmits the user's answer to the server.

[2291] Input: The answer obtained

[2292] Output: The answer sent to the server

[2293] Specific behavior:

[2294] The terminal sends the answer "yes" to the server.

[2295] Step 3:

[2296] The server analyzes the answers and evaluates the user's mental state.

[2297] Input: The answer sent to the server

[2298] Output: Mental state evaluation results

[2299] Specific behavior:

[2300] The server analyzes the responses and assesses that "stress may be increasing."

[2301] Step 4:

[2302] The server generates appropriate advice based on the analysis results and provides it to the user via the terminal.

[2303] Input: Mental state assessment results

[2304] Output: Generated advice

[2305] Specific behavior:

[2306] The server generates advice such as "Try deep breathing to relax" and sends it to the terminal.

[2307] The terminal displays the advice to the user and provides voice guidance.

[2308] Economical meal suggestions

[2309] Step 1:

[2310] When the user wants to eat, they input a request into the terminal, and the terminal acquires their current location.

[2311] Input: Meal request, current location information

[2312] Output: Retrieved request and location information

[2313] Specific behavior:

[2314] A user requests, "Tell me where I can get a cheap, healthy meal nearby."

[2315] The device obtains location information from GPS as "latitude 34.0522, longitude -118.2437".

[2316] Step 2:

[2317] The server collects information about nearby restaurants based on the current location information.

[2318] Input: Current location information

[2319] Output: Collected restaurant information

[2320] Specific behavior:

[2321] The server calls the Yelp API and collects restaurant information based on the location information "latitude 34.0522, longitude -118.2437".

[2322] Step 3:

[2323] The server uses the collected information to search for prices, menus, and health-conscious options.

[2324] Input: Collected restaurant information

[2325] Output: Best meal options

[2326] Specific behavior:

[2327] The server analyzes the data and selects healthy options such as "XYZ restaurant, salad for 550 yen."

[2328] Step 4:

[2329] The server sends the results to the terminal, which displays the information to the user.

[2330] Enter: Best Meal Options

[2331] Output: Data displayed to the user

[2332] Specific behavior:

[2333] The server sends the optimal option, "XYZ Restaurant, salad for 550 yen," to the terminal.

[2334] The device displays this to the user and notifies them with a voice message saying, "We recommend the nearby XYZ restaurant."

[2335] Real-time communication

[2336] Step 1:

[2337] The user inputs data by voice or text, which the device recognizes and sends to the server.

[2338] Input: User voice or text input

[2339] Output: Recognized text data

[2340] Specific behavior:

[2341] The user speaks, "Tell me what the weather will be like tomorrow."

[2342] The device converts the voice into text and sends it to the server.

[2343] Step 2:

[2344] The server parses the input and generates an appropriate response.

[2345] Input: Recognized text data

[2346] Output: The generated response

[2347] Specific behavior:

[2348] The server analyzes "What's the weather like tomorrow?"

[2349] Obtain data such as "It will be sunny tomorrow" from a weather forecast service (e.g., OpenWeather API).

[2350] Step 3:

[2351] The server sends the response to the terminal, which displays or plays it aloud to the user.

[2352] Input: Generated response

[2353] Output: Data displayed or played back to the user

[2354] Specific behavior:

[2355] The server responds by sending the message "It will be sunny tomorrow" to the terminal.

[2356] The device will display this and play a voice saying "Tomorrow will be sunny."

[2357] Telemedicine Support

[2358] Step 1:

[2359] When a user feels unwell, they request a remote medical service via their terminal.

[2360] Input: Telehealth service request

[2361] Output: Request data to the server

[2362] Specific behavior:

[2363] The user enters a request saying, "I'm not feeling well and would like to talk to a doctor."

[2364] The device sends a request to the server.

[2365] Step 2:

[2366] The server receives the request and assigns the appropriate medical professional.

[2367] Input: Request data, medical professional database

[2368] Output: Assigned medical professional

[2369] Specific behavior:

[2370] The server selects and assigns the most suitable medical professional from a doctor database.

[2371] Step 3:

[2372] The server establishes a connection with a medical professional and the terminal provides the user with video calling or chat functionality.

[2373] Input: Assigned medical professional, connection request

[2374] Output: Establishing a connection, calling and chatting with the user

[2375] Specific behavior:

[2376] The server establishes a connection with the medical professional and notifies the device.

[2377] The device will prompt the user to "Start a call with your doctor" and begin the video call or chat.

[2378] (Application example 1)

[2379] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2380] Truck drivers and logistics center staff work in harsh environments, and are required to perform their work safely and efficiently while managing their health. However, there is no system that comprehensively supports these tasks. Therefore, the challenge is to provide a system that integrates route optimization, health management, mental support, economical and healthy meal suggestions, real-time communication, and remote medical support.

[2381] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2382] In this invention, the server includes means for optimizing driving routes for truck drivers, means for acquiring and analyzing health data, means for providing mental support, means for suggesting economical and healthy meals, means for real-time communication with users, means for providing remote medical support, means for calculating and displaying optimal delivery routes within a logistics center, means for continuously transmitting health monitoring data to the server and generating alerts when an abnormality is detected...

Claims

1. A means of optimizing routes for truck drivers; a means of acquiring and analyzing health data; means of providing mental support; A means of suggesting economical and healthy meals, a means for real-time communication with the user; A system including a means for providing telehealth support.

2. 2. The system according to claim 1, wherein the route optimization means calculates and presents an optimal route using real-time traffic information and map data.

3. 2. The system according to claim 1, wherein the health data acquisition means periodically acquires data from the sensor device and generates an alert when an abnormality is detected.

4. 2. The system according to claim 1, wherein the mental support means evaluates the user's mental state through periodic questions and provides appropriate advice.

5. The system according to claim 1, wherein the means for suggesting economical and healthy meals collects information on nearby restaurants based on current location information and presents optimal meal options.

6. 2. The system according to claim 1, wherein the real-time communication means realizes a dialogue with the user by means of voice recognition and text analysis functions.

7. 2. The system according to claim 1, wherein the remote medical support means assigns a medical expert based on a request from the user and provides a diagnosis and advice in real time.

Images