System

Abstract

A system is provided.SOLUTION: A system comprising: means for collecting data; means for analyzing the collected data; and means for notifying a user device of an analysis result in real time.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When natural disasters such as earthquakes occur, appropriate information may not be disseminated quickly, especially in rural areas or areas with poor infrastructure, which can delay evacuation. In such situations, a support system is needed to enable individual users to obtain appropriate information and quickly evacuate themselves and their families to a safe location. In particular, when many different information sources are provided in a chaotic information environment, users may become confused about which information to follow. Furthermore, if users do not register the necessary personal information during normal times, it will be difficult for them to receive appropriate evacuation instructions when a disaster occurs. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means. The present invention is a system including a means for collecting data, a means for analyzing the collected data, and a means for notifying a user device of the analysis results in real time. The system further includes a means for registering a user's personal information in normal times, a means for providing individual evacuation instructions based on the user's registered information in an emergency, and a means for reporting the user's evacuation status to a server. The system also includes a means for periodically updating the user's device with the latest evacuation information, a means for the device to receive emergency notifications from the server and display them to the user, and a means for transmitting user feedback to the server. This allows users to quickly and appropriately obtain necessary information in an emergency and take safe evacuation action.

[0006] "Means for collecting data" refers to devices or systems that collect data such as earthquake, weather, traffic, and evacuation shelter information from various sources.

[0007] "Means for analyzing collected data" refers to analytical devices or programs that generate damage predictions, evacuation instructions, etc. based on the collected data.

[0008] "Means for notifying the user device of the analysis results in real time" refers to a system or function for instantly sending the analyzed information to the user device and notifying the user.

[0009] The "means for registering user personal information in peacetime" refers to a device or interface that allows a user to register their own personal information before a disaster occurs.

[0010] "Means for providing individual evacuation instructions based on the user's registered information in an emergency" refers to a device or program that creates and provides individual evacuation instructions in the event of a disaster based on personal information registered by the user.

[0011] The "means for reporting the user's evacuation status to the server" is a device or interface for transmitting information to the server that the user has completed evacuation.

[0012] "Means for regularly updating the latest evacuation information" refers to a function or system that regularly updates evacuation information to user devices.

[0013] The "means for receiving an emergency notification and displaying it to the user" refers to a device or program that allows the user device to receive an emergency notification from the server and display it to the user.

[0014] The "means for transmitting user feedback to the server" refers to a function or interface for transmitting the user's evacuation completion report or additional assistance request to the server. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This paper describes a system that collects data, analyzes it, and notifies the results to user devices in real time. The system is intended to support evacuation in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[0037] Server Processing

[0038] 1. Data Collection

[0039] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[0040] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[0041] 2. Data Analysis

[0042] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[0043] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[0044] 3. Individual support information generation

[0045] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[0046] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[0047] 4. Notification sending

[0048] The server notifies the user device of analysis results and evacuation instructions in real time.

[0049] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[0050] Terminal handling

[0051] 1. Receiving notifications

[0052] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[0053] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[0054] 2. Information display

[0055] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[0056] - Example: The device displays the safest evacuation route on a map.

[0057] 3. Two-way communication

[0058] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[0059] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[0060] User behavior

[0061] 1. Initial Setup

[0062] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[0063] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[0064] 2. Emergency Response

[0065] Users can quickly take evacuation action by following the notifications on their devices.

[0066] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[0067] 3. Reporting completion of evacuation

[0068] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[0069] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[0070] Specific examples

[0071] 1. Scenario: Evacuation immediately after an earthquake occurs

[0072] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[0073] - The device receives evacuation warnings from the server and notifies the user via push notification.

[0074] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[0075] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[0076] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" helps users take swift and appropriate evacuation actions. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operations are described in detail in the processing steps below.

[0077] The processing flow will be explained below.

[0078] Step 1: Initial Setup (Normal)

[0079] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information, etc.).

[0080] Step 2: Upload your information

[0081] The terminal sends the information entered by the user to the server, and the terminal uploads the user data to the server using a secure communication protocol (e.g., HTTPS).

[0082] Step 3: Update the database

[0083] The server stores the received information in a database. The server creates a new user entry in the database and stores the personal information.

[0084] Step 4: Periodic data collection

[0085] The server periodically collects data from various sources, such as the Japan Meteorological Agency API, traffic information API, and evacuation shelter information API.

[0086] Step 5: Analyze and save

[0087] The server analyzes the collected data and stores the necessary information in a database. The server also stores new earthquake risk assessments and evacuation shelter status information.

[0088] Step 6: Update information

[0089] The device periodically retrieves data from the server and stores it in local storage. The device queries the server daily or at a specified frequency and stores the latest information locally.

[0090] Step 7: Obtain emergency information

[0091] The server immediately obtains earthquake occurrence information. The server receives immediate notification when an earthquake occurs via the Japan Meteorological Agency's real-time API.

[0092] Step 8: Real-time analysis

[0093] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity and impact area of ​​the earthquake and identify areas where evacuation warnings are required.

[0094] Step 9: Generate notifications

[0095] The server generates evacuation advisory notices based on the analysis results. The server creates notices for highly affected areas that include specific evacuation instructions and information on safe evacuation routes.

[0096] Step 10: Send emergency notifications

[0097] The server sends an emergency notification to the device. The server uses a push notification service (e.g., Firebase Cloud Messaging) to send the emergency notification to the user's device in real time.

[0098] Step 11: Receiving and viewing notifications

[0099] The device receives the emergency notification from the server and displays it to the user. The device notifies the user of the emergency information using a voice alert or push notification.

[0100] Step 12: Check evacuation instructions

[0101] The user checks the notification on the device and begins the specified evacuation action. The user then checks the evacuation route and location information of the evacuation shelter on the device screen.

[0102] Step 13: Evacuation

[0103] The user follows the evacuation route indicated by the device and moves to a safe location. The user heads to the designated evacuation shelter using the map and route information displayed on the device as a reference.

[0104] Step 14: Evacuation completion report

[0105] When the user has completed evacuation, they press the evacuation completion button on their device. When the user arrives at the evacuation shelter, they tap the evacuation completion button in the app.

[0106] Step 15: Submitting the completed information

[0107] The terminal sends an evacuation completion report to the server. The terminal sends the evacuation completion information to the server along with the user's location data.

[0108] Step 16: Database Update

[0109] The server stores the evacuation completion information in a database and manages the evacuation situation. The server updates the evacuation situation map in real time based on the received evacuation completion data.

[0110] Example 1

[0111] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0112] In modern society, rapid and accurate information provision and evacuation instructions are required when a disaster occurs. However, conventional systems can be slow in collecting and analyzing information, making it difficult for users to take appropriate evacuation actions. Another problem is that support tailored to each user's individual situation is not provided adequately. In particular, it has been technically difficult to provide analysis results and issue individual evacuation instructions in real time. There is a need for a system that can solve these issues.

[0113] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0114] In this invention, the server includes a means for collecting information, a means for analyzing the collected information, and a means for notifying a user terminal of the analysis results in real time. This allows users to receive prompt and accurate information and take appropriate evacuation actions. The server also includes a means for collecting information from various sources in an emergency, a means for predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users, a means for registering personal information of users in normal times, a means for generating individual evacuation instructions and support information in the event of a disaster, and a means for reporting the user's status to the server, thereby providing support tailored to each user's individual situation. Furthermore, the user terminal includes a means for receiving emergency notifications from the server and presenting them to the user, a means for transmitting user feedback to the server, and a means for periodically updating the user terminal with the latest evacuation information. This allows users to always receive the latest and most reliable information and encourage appropriate evacuation actions.

[0115] - "Means of collecting information" refers to the system for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[0116] "Means for analyzing collected information" refers to algorithms and software that use the acquired data to predict the extent of the disaster's impact and damage.

[0117] "Means for notifying the user terminal of the analysis results in real time" refers to a communication means for instantly transmitting the analyzed data to the user's device.

[0118] "A means of predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users" is a system for assessing the impact of a disaster when it occurs and instructing users on the most appropriate course of action.

[0119] "Means for registering users' personal information in peacetime" refers to a system for registering personal information such as users' addresses and emergency contact details before a disaster occurs.

[0120] "Means for generating individual evacuation instructions and support information in the event of a disaster" refers to a system that provides information on appropriate evacuation routes and evacuation locations in the event of a disaster, based on information registered in advance by the user.

[0121] "Means for reporting the user's status to the server" refers to a communication means for transmitting the user's current location and evacuation status to the server, and for the server to grasp this information.

[0122] "Means for the user terminal to receive emergency notifications from the server and present them to the user" refers to a mechanism by which the user's device receives emergency information sent from the server and provides feedback to the user.

[0123] "Means for sending user feedback to the server" refers to a mechanism for sending information and status reports provided by users to the server.

[0124] "Means for regularly updating the latest evacuation information to user devices" refers to a system that regularly delivers the latest evacuation information to users' devices and keeps the information up to date.

[0125] This invention relates to a system that provides evacuation instructions and support information quickly and accurately in the event of an emergency such as a natural disaster. This system is composed of three main elements: a server, terminals, and users, each of which fulfills a specific role to function as a whole.

[0126] Server embodiment

[0127] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources. This data is collected using Python scripts that retrieve information from external data providers such as the Japan Meteorological Agency's API. The data obtained is in JSON format and stored in the server's database.

[0128] The server then analyzes the collected data in real time. It uses Python libraries such as Pandas and NumPy to create data frames, and uses statistical processing and machine learning models to predict the extent of the disaster's impact and damage. The analysis results are then used to generate appropriate evacuation instructions for users.

[0129] Furthermore, the server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times. Specifically, it uses the Geopandas library to identify the nearest evacuation shelter and safe evacuation route from the user's address information using GIS data.

[0130] Finally, the server notifies the user device in real time of the analysis results and evacuation instructions using Firebase Cloud Messaging (FCM), and the server calls the FCM API to send push notifications.

[0131] Terminal embodiment

[0132] The device receives notifications from the server and notifies the user via push notifications or voice alerts. For example, on Android devices, notifications are received using Firebase's notification manager. If an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency alert.

[0133] The device also displays the received evacuation and support information in an easy-to-understand manner to the user. By using the Google Maps API, evacuation routes are visually displayed on a map, allowing users to easily check their evacuation routes.

[0134] The device also sends user feedback to the server, allowing the server to understand the user's current location and evacuation status in real time and provide additional assistance information as needed.When the user presses the evacuation completion button, the device sends an HTTP request to the server, updating the status in the database.

[0135] User's embodiment

[0136] Users register their personal information with the application during normal times, including their name, address, emergency contact information, etc. This information is stored on the device and securely transferred to the server when necessary.

[0137] When an emergency occurs, the user quickly takes evacuation action according to the notification from the device. For example, the user checks the notification on the device and moves to a safe shelter according to the evacuation route displayed. After completing the evacuation, the user presses the evacuation completion button on the device to report to the server.

[0138] Specific examples

[0139] Example prompt:

[0140] "Please tell me the evacuation route immediately after an earthquake occurs. Please suggest the optimal evacuation route based on the information obtained from the server."

[0141] In response to such prompts, the system generates the optimal evacuation route in real time based on the user's current location and information on the nearest evacuation shelter, and notifies the user. The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area, and the device receives evacuation advisories from the server and notifies the user via push notification. The user checks the notification on their device, takes the specified evacuation action, and after arriving at the evacuation shelter, presses the evacuation completion button to report to the server.

[0142] As a result, the system of the present invention can provide prompt and accurate evacuation support in the event of a disaster, thereby minimizing damage.

[0143] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0144] Step 1: Gather information

[0145] Input: Real-time data provided by APIs from external sources (such as the Japan Meteorological Agency and traffic information providers)

[0146] Specific operation: The server periodically executes a Python script and sends requests to the Japan Meteorological Agency's API, which retrieves data in JSON format, such as earthquake, weather, traffic, and evacuation shelter information. The server automatically collects this data and stores it in a database.

[0147] Output: Various disaster-related data stored in the database

[0148] Step 2: Data analysis

[0149] Input: Collected data stored in a database

[0150] Specific operation: The server uses Python's Pandas and NumPy libraries to create a data frame. Based on this, statistical processing and machine learning models are applied to predict the extent of the disaster impact and damage. For example, earthquake data is analyzed to calculate the epicenter, magnitude, and damage forecast.

[0151] Output: Analysis results (e.g., risk of building collapse in a specific area, evacuation advisories)

[0152] Step 3: Generate personalized support information

[0153] Input: User's registered personal information (address, emergency contact, etc.) and analysis results

[0154] Specific operation: The server uses the user's personal information acquired during normal times to identify the best evacuation shelter and safe evacuation route using libraries such as Geopandas. For example, it searches for the nearest evacuation shelter based on the user's address information and generates a route to that shelter.

[0155] Output: Individual evacuation instructions and support information (e.g., evacuation shelter list, evacuation route)

[0156] Step 4: Send notification

[0157] Input: Individual evacuation instructions and support information

[0158] Specific operation: The server uses Firebase Cloud Messaging (FCM) to send notifications to the user's device in real time. It calls the FCM API and sends appropriate evacuation warnings and route information to the user via push notifications.

[0159] Output: Evacuation notification sent to user device

[0160] Step 5: Receive notifications

[0161] Input: Notification sent from the server

[0162] Specific operation: The device receives notifications from the FCM and displays alerts and push notifications to the user. For example, if an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency notification to the user.

[0163] Output: Urgent notification displayed on the user's screen

[0164] Step 6: Display information

[0165] Input: Received evacuation instructions and assistance information

[0166] How it works: The device uses the Google Maps API to visually display evacuation routes, allowing users to identify safe evacuation routes and the location of evacuation shelters.

[0167] Output: Evacuation route and shelter information displayed on the device screen

[0168] Step 7: Two-way communication

[0169] Input: User feedback (e.g., information on pressing the evacuation complete button)

[0170] Specific operation: When a user arrives at a shelter and presses the "Evacuation Complete" button on their device, that information is sent to the server as an HTTP request. The server receives this information and updates the database.

[0171] Output: Evacuation completion information sent to the server

[0172] Step 8: Initial Setup

[0173] Input: User's personal information (name, address, emergency contact, etc.)

[0174] Specific operation: The user enters the necessary information on the app's settings screen, which is saved on the device. The data is then transferred to the server via secure communication and registered in the database.

[0175] Output: Personal information of registered users

[0176] Step 9: Emergency response

[0177] Input: Evacuation information received from the server

[0178] Specific actions: The user checks the notification on the device and takes prompt action to evacuate by following the displayed evacuation route. Specifically, the user follows the evacuation route on the map and moves to a safe evacuation shelter.

[0179] Output: User's evacuation behavior

[0180] Step 10: Evacuation completion report

[0181] Input: User's evacuation completion operation (pressing the evacuation completion button)

[0182] Specific operation: When the user arrives at the evacuation shelter and presses the evacuation completion button, the device sends the information to the server. The server receives this report and updates the database to record the evacuation completion status.

[0183] Output: Evacuation completion information recorded on the server

[0184] (Application example 1)

[0185] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0186] To enable autonomous vehicles and other mobile devices to evacuate quickly and efficiently in the event of a disaster, a system is needed that can obtain disaster information in real time, provide optimal evacuation routes, and automatically follow those routes. It is also necessary to grasp the user's evacuation status in real time and provide additional assistance. Conventional systems do not integrate these functions, making it difficult for users to evacuate quickly and effectively.

[0187] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0188] In this invention, the server includes a means for collecting data, a means for analyzing the collected data, and a means for notifying the user device of the analysis results in real time. This enables real-time acquisition and analysis of disaster information and provision of optimal evacuation routes during disasters. Furthermore, this invention also includes a means for displaying optimal evacuation routes for mobile objects based on the analysis results, and a means for the mobile object to automatically move along the evacuation route. This enables self-driving vehicles and other mobile objects to evacuate quickly and efficiently.

[0189] "Means of collecting data" refers to systems and methods for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[0190] "Means for analyzing collected data" refers to systems and methods for analyzing acquired data and predicting the extent of the impact and damage of a disaster.

[0191] "Means for notifying a user device of analysis results in real time" refers to a system or method for instantly delivering and notifying a user device of analysis results.

[0192] "Means for displaying the optimal evacuation route for a moving object based on the analysis results" refers to a system or method for presenting the optimal evacuation route for a moving object based on analyzed evacuation information.

[0193] "Means for a mobile body to automatically move along an evacuation route" refers to a system or method in which a mobile body automatically operates along a presented optimal evacuation route.

[0194] "Means for registering users' personal information in peacetime" refers to systems and methods for registering users' personal information in a database before a disaster occurs.

[0195] "Means for providing individual evacuation instructions based on user registration information in an emergency" refers to a system or method that uses user registration information to provide individually customized evacuation instructions in the event of a disaster.

[0196] "Means for reporting the user's evacuation status to the server" refers to a system or method for transmitting and reporting the user's evacuation status to the server.

[0197] "Means for monitoring evacuation situations in real time and providing additional support information" refers to a system or method for monitoring a user's evacuation situation in real time and providing any additional support that is required.

[0198] "Means for regularly updating the latest evacuation information to the user's device" refers to a system or method for regularly updating the latest evacuation information to the user's device.

[0199] "Means for a device to receive an emergency notification from a server and display it to a user" refers to a system or method in which a device receives an emergency message from a server and displays an alert to a user.

[0200] "Means for transmitting user feedback to a server" refers to a system or method for transmitting user-provided information or feedback to a server.

[0201] "Means for notifying the server of the evacuation completion status of a mobile body in an emergency" refers to a system or method for reporting to the server that the evacuation of a mobile body has been completed in an emergency.

[0202] This invention is a system that supports autonomous vehicles and other mobile objects to evacuate quickly and efficiently in the event of a disaster. Here, we will explain the roles of the server, terminal, and user, as well as the specific implementation method of the entire system.

[0203] Server Processing

[0204] 1. Data Collection

[0205] The server periodically obtains data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources using APIs. This process is achieved using a programming language such as Python and a library for making HTTP requests (e.g., requests).

[0206] 2. Data Analysis

[0207] The collected data is analyzed in real time to predict the extent of the disaster impact and damage. This is done using machine learning models and data analysis libraries (e.g., scikit-learn). Based on the analysis results, the optimal evacuation route is calculated.

[0208] 3. Sending notifications

[0209] The analysis results are sent to the user's device in real time using a push notification service (e.g., Firebase Cloud Messaging).

[0210] Terminal handling

[0211] 1. Receiving notifications

[0212] The terminal receives notifications from the server and notifies the user via push notifications or audio alerts. This role is played by user devices such as smartphones or head-mounted displays (HUDs).

[0213] 2. Information display

[0214] The device will then display the received evacuation information in an easy-to-understand manner. In particular, the HUD of the autonomous vehicle will display evacuation routes. This will be done using a map display library (e.g., Google Maps API).

[0215] 3. Two-way communication

[0216] The device sends user feedback to a server and monitors the evacuation situation in real time, allowing it to provide additional assistance if needed.

[0217] User Behavior

[0218] 1. Initial Setup

[0219] Users register their personal information in normal times using a smartphone app or web interface.

[0220] 2. Emergency Response

[0221] Users receive notifications from their devices and follow instructions to quickly take evacuation action. In the case of autonomous vehicles, the vehicles will automatically begin moving along the evacuation route provided.

[0222] 3. Reporting completion of evacuation

[0223] When the user arrives at the evacuation shelter, they press the evacuation completion button on their device to report to the server. This information is used to appropriately plan the next evacuation measures.

[0224] Specific examples

[0225] For example, if an earthquake occurs while a user is in an autonomous vehicle, the system immediately obtains the latest disaster information and calculates and displays the optimal evacuation route. The autonomous vehicle then automatically begins driving and continues to a safe evacuation shelter. After arriving at the evacuation shelter, the user can use their device to report the completion of evacuation to the server, and the server can use that information to provide additional assistance.

[0226] Prompt Sentence Examples

[0227] "Design an application that provides detailed earthquake information, calculates and displays the route from your current location to the best evacuation shelter, and includes a function that allows an autonomous vehicle to automatically evacuate by following that route."

[0228] The above is a specific embodiment of the disaster evacuation support system of the present invention, which enables users to evacuate quickly and efficiently based on real-time disaster information.

[0229] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0230] Processing steps and specific operations

[0231] Step 1:

[0232] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources via API. Specifically, it sends HTTP requests to API endpoints such as those of the Japan Meteorological Agency and traffic information providers, and obtains the returned JSON data. This collected data becomes the input for processing and is stored internally on the server.

[0233] Step 2:

[0234] The server analyzes the collected data in real time, using machine learning generative AI models and data analysis libraries (e.g., scikit-learn). The purpose of the analysis is to predict the extent of the disaster's impact and damage, using collected weather and earthquake information as input data, and then outputting specific analysis results such as evacuation routes.

[0235] Step 3:

[0236] The server then sends real-time evacuation information to the user device based on the analysis results. This notification is sent using a push notification service (e.g., Firebase Cloud Messaging). Specifically, the server formats the analysis results and sends a push notification specifying the user device's identifier. During this process, the notification content is generated as output data.

[0237] Step 4:

[0238] The device receives the notification sent from the server and notifies the user. Specifically, a smartphone or head-mounted display (HUD) receives a push notification and displays it to the user as an audio alert or a pop-up on the screen. This notification becomes input data and is output in the form of an alert display.

[0239] Step 5:

[0240] The device displays the optimal evacuation route to the user. A map display library (e.g., Google Maps API) is used to display the evacuation route. After receiving the push notification, the device obtains the evacuation route information as an analysis result and displays it on the device screen or HUD. The input of this process is the notification from the server, and the output is a visual representation of the evacuation route.

[0241] Step 6:

[0242] The autonomous vehicle automatically begins moving according to the displayed evacuation route. The vehicle's autonomous driving system manages this process and generates the control signals necessary to operate according to the evacuation route. The input is the evacuation route information, and the output is the movement of the vehicle.

[0243] Step 7:

[0244] The device reports the user's evacuation completion status to the server. Specifically, when the user arrives at the evacuation shelter and presses the evacuation completion button on the device, a message indicating evacuation completion is sent to the server. The input is the user's operation, and the output is the report data.

[0245] Step 8:

[0246] The server receives the evacuation completion report and provides additional support information as needed. This support information is generated using a generative AI model based on the latest situation and notified to the user device. The input is the evacuation completion report data, and the output is the support information.

[0247] Through the above processing steps, the disaster evacuation support system of the present invention supports mobile bodies, including autonomous vehicles, in taking evacuation actions quickly and efficiently.

[0248] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0249] This invention combines a system that collects data, analyzes it, and notifies the user device of the results in real time with an emotion engine that recognizes the user's emotions and provides evacuation instructions and support information based on those emotions. The aim is to help users receive appropriate information and take swift and calm evacuation action, particularly in the event of a disaster. The system consists of three main elements: a server, a terminal, and a user, to which the emotion engine is added.

[0250] Server Processing

[0251] 1. Data Collection

[0252] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[0253] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[0254] 2. Data Analysis

[0255] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[0256] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[0257] 3. Individual support information generation

[0258] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[0259] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[0260] 4. Notification sending

[0261] The server notifies the user device of analysis results and evacuation instructions in real time.

[0262] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[0263] 5. Emotional Data Analysis

[0264] The server analyzes the data from the emotion engine and generates additional support information and advice based on the user's emotional state.

[0265] - Example: The server provides advice on how to relax if the user is feeling stressed.

[0266] Terminal handling

[0267] 1. Receiving notifications

[0268] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[0269] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[0270] 2. Information display

[0271] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[0272] - Example: The device displays the safest evacuation route on a map.

[0273] 3. Emotional state monitoring

[0274] The device monitors the user's emotional state in real time and provides advice and messages to calm the emotions as needed.

[0275] - Example: The device can recognize the user's facial expressions and suggest relaxation techniques if they are feeling anxious.

[0276] 4. Emotional State Report

[0277] The device uses an emotion engine to detect the user's emotional state and transmits it to the server.

[0278] - Example: The device sends information about the user's stress to the server.

[0279] 5. Two-way communication

[0280] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[0281] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[0282] User behavior

[0283] 1. Initial Setup

[0284] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[0285] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[0286] 2. Emergency Response

[0287] Users can quickly take evacuation action by following notifications on their device, and calm down by following advice on the device.

[0288] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[0289] 3. Reporting completion of evacuation

[0290] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[0291] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[0292] Specific examples

[0293] 1. Scenario: Evacuation immediately after an earthquake occurs

[0294] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[0295] - The device receives evacuation warnings from the server and notifies the user via push notification.

[0296] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[0297] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[0298] - The device monitors the user's emotional state and provides relaxation advice if they are feeling stressed.

[0299] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" supports swift and appropriate evacuation actions while taking into account the user's emotional state. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operation are described in detail in the processing steps below.

[0300] The processing flow will be explained below.

[0301] Step 1: User Registration

[0302] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information).

[0303] Step 2: Send information

[0304] The device sends the information entered by the user to the server. The device transmits the data securely using HTTPS.

[0305] Step 3: Update the database

[0306] The server stores the received user information in a database. The server creates a new user entry and stores the personal information securely.

[0307] Step 4: Data collection during normal times

[0308] The server periodically collects earthquake information, weather information, traffic information, evacuation shelter information, etc. from related organizations. The server obtains the latest information using API.

[0309] Step 5: Data analysis during normal times

[0310] The server analyzes the collected data and stores the necessary information in a database. The server updates the database with new risk assessments and shelter status information.

[0311] Step 6: Update information

[0312] The device retrieves data from the server and stores it in local storage. The device queries the server at a specified frequency and downloads the latest information.

[0313] Step 7: Obtain emergency information

[0314] The server obtains earthquake occurrence information in real time. The server receives earthquake information via the Japan Meteorological Agency's real-time API.

[0315] Step 8: Real-time data analysis

[0316] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity and impact area, and identifies areas where evacuation orders are required.

[0317] Step 9: Generate notifications

[0318] The server generates evacuation advisory notices based on the analysis results. The server creates notices that include specific evacuation instructions and evacuation routes.

[0319] Step 10: Send emergency notifications

[0320] The server sends emergency notifications to the device. The server uses a push notification service to send emergency notifications in real time.

[0321] Step 11: Receiving and viewing notifications

[0322] The device receives the emergency notification and notifies the user. The device notifies the user of the emergency information via voice alerts or push notifications.

[0323] Step 12: Check evacuation instructions

[0324] The user confirms the notification and begins the specified evacuation action. The user checks the evacuation route and evacuation shelter information on the device screen.

[0325] Step 13: Emotional State Monitoring

[0326] The device monitors the user's emotional state in real time and evaluates the user's emotions using facial expression recognition and voice analysis.

[0327] Step 14: Sending Emotion Data

[0328] The device sends the data obtained from the emotion engine to the server, and the device periodically reports the user's stress level and emotional state.

[0329] Step 15: Sentiment Data Analysis

[0330] The server analyzes the emotional data and generates support information based on the emotional state. If stress levels are high, the server generates relaxation advice.

[0331] Step 16: Evacuation

[0332] The user follows the evacuation route indicated by the device to a safe location. The user follows the map and route information displayed on the device.

[0333] Step 17: Providing emotional support information

[0334] The device receives the emotional support information from the server and displays it to the user. The device displays a message for stress reduction.

[0335] Step 18: Evacuation completion report

[0336] When the user has completed the evacuation, they press the evacuation completion button on their device. After arriving at the evacuation shelter, the user reports that the evacuation has been completed.

[0337] Step 19: Submit completion information

[0338] The terminal sends a report of completion of evacuation to the server. The terminal also sends information about arrival at the evacuation shelter to the server.

[0339] Step 20: Update the database

[0340] The server stores the evacuation completion information in a database and manages the evacuation situation. The server updates the evacuation situation map in real time.

[0341] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" utilizes an emotion engine to support quick and appropriate evacuation actions while taking into account the user's emotional state, enabling safe and effective evacuation even in a chaotic information environment.

[0342] Example 2

[0343] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0344] Conventional disaster response systems focus on collecting, analyzing, and notifying users of disaster information, but lack the ability to provide evacuation instructions and support information that takes into account the user's emotional state. This makes it difficult for users who are stressed or anxious to take appropriate evacuation actions. Furthermore, they are also inadequate in properly monitoring the user's emotional state in an emergency and providing support based on that state. Therefore, the present invention is required to analyze the user's emotional state in real time and provide appropriate support.

[0345] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for collecting data, a means for analyzing the collected data, a means for notifying the user device of the analysis results in real time, a means for analyzing the emotional state of the user, a means for generating support information based on the emotional state, and a means for notifying the user device of the support information. This enables the user to receive appropriate evacuation instructions and support in real time, taking into account the emotional state, even in the event of a disaster.

[0346] 1. "Means of collecting data" refers to the function for obtaining data on disasters in real time from various sources.

[0347] 2. "Means for analyzing collected data" refers to a function that processes acquired data in real time and predicts the extent of the impact of a disaster and damage.

[0348] 3. "Means for notifying the user device of analysis results in real time" refers to a function for quickly sending and notifying the user device of analysis results.

[0349] 4. "Means for analyzing the user's emotional state" refers to a function for understanding the user's current emotional state by collecting and analyzing emotional data.

[0350] 5. "Means for generating support information based on emotional state" is a function for creating support information and advice appropriate for the user based on the analyzed emotional state.

[0351] 6. "Means for notifying user devices of assistance information" refers to a function for notifying user devices of generated assistance information in real time.

[0352] 7. "Means for registering user personal information during normal times" refers to a function for registering a user's personal information and location in the system when no disaster has occurred.

[0353] 8. "Means for providing individual evacuation instructions based on the user's registered information in an emergency" refers to a function for providing appropriate evacuation instructions to the user in an emergency based on personal information registered in advance.

[0354] 9. "Means for reporting the user's evacuation status to the server" is a function that allows the user to communicate the evacuation status to the server.

[0355] 10. "Means for monitoring the user's emotional state" means a function that monitors the user's emotional state in real time and collects data as necessary.

[0356] 11. "Means for providing emotional support information based on monitoring results" refers to a function for providing support information appropriate to the user in real time based on collected emotional data.

[0357] 12. "Means for periodically updating the latest evacuation information on the user's device" refers to a function for periodically sending and updating the latest evacuation information on the user's device.

[0358] 13. "Means for a terminal to receive an emergency notification from a server and display it to the user" refers to a function that allows a user's terminal to receive an emergency notification sent from a server and display it to the user.

[0359] 14. "Means for sending user feedback to the server" refers to a function for sending information and opinions entered by users to the server.

[0360] 15. "Means for reporting the user's emotional state to the server" means a function for transmitting and reporting data on the user's emotional state to the server.

[0361] This invention combines a system that collects disaster information, analyzes it, and notifies the user device of the results in real time with an emotion engine that recognizes the user's emotions and provides evacuation instructions and support information based on those emotions. The system consists of three main elements: a server, a terminal, and a user, to which an emotion engine is added.

[0362] Server configuration and processing

[0363] The server has the following main functions:

[0364] 1. Data Collection

[0365] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources using APIs.

[0366] Specifically, we use the Japan Meteorological Agency's API and traffic information API. For example, run curl -s http: / / api.weather.go.jp / earthquake to obtain earthquake data.

[0367] 2. Data Analysis

[0368] Using libraries such as Python, the collected data is analyzed in real time, and algorithms are run to estimate damage and the extent of impact in specific areas.

[0369] Example: Using pandas and numpy to process earthquake data and assess the risk of building collapse.

[0370] 3. Individual support information generation

[0371] Individual evacuation instructions and support information are generated based on the personal information and location information of users that have been registered in advance.

[0372] For example, an SQL query can be used to retrieve a user's address information and list information about evacuation shelters in that area.

[0373] 4. Notification sending

[0374] Using Firebase Cloud Messaging (FCM), analysis results and evacuation instructions are sent to user devices in real time.

[0375] Example: Using the FCM API to send an urgent notification via a POST request.

[0376] 5. Emotional Data Analysis

[0377] The data provided by the emotion engine is analyzed to generate additional support information and advice based on the user's emotional state.

[0378] Example: Using an NLP library (e.g., spaCy) to analyze emotion data and generate relaxation advice.

[0379] Terminal configuration and handling

[0380] The terminal has the following main functions:

[0381] 1. Receiving notifications

[0382] Receives emergency notifications sent from the server and notifies the user via push notifications or voice alerts.

[0383] Example: Display a notification using the onMessageReceived method in an Android app.

[0384] 2. Information display

[0385] The received action advice and evacuation information are visually displayed to the user. Evacuation routes and shelters are displayed using a map API.

[0386] Example: Displaying evacuation routes on a map using the Google Maps API.

[0387] 3. Emotional state monitoring

[0388] It uses the device's camera to recognize the user's facial expressions in real time and sends that data to the emotion engine.

[0389] Example: Facial expression recognition using OpenCV and dlib libraries.

[0390] 4. Emotional State Report

[0391] The user's emotional state is periodically transmitted to the server.

[0392] Example: Send emotion data to the server using an HTTP POST request.

[0393] 5. Two-way communication

[0394] User feedback and evacuation status are reported to the server.

[0395] Example: When a user presses the "Evacuation Complete" button, that information is sent to the server via a POST request.

[0396] User Behavior

[0397] The user uses the system as follows:

[0398] 1. Initial Setup

[0399] Register your personal information and emergency contact information in the app during normal times.

[0400] Example: Enter your address and contact information on the settings screen and press the save button.

[0401] 2. Emergency Response

[0402] Follow the notifications on your device to quickly take evacuation action. Move along the evacuation route provided by your device.

[0403] For example: Tap on a notification on your phone to see more information and follow the instructions to a safe haven.

[0404] 3. Reporting completion of evacuation

[0405] Once the evacuation is complete, press the "Evacuation Complete" button on the device to report to the server.

[0406] Example: After arriving at a shelter, press the "Evacuation Complete" button in the app to send the information.

[0407] As a result, the system of the present invention can support quick and appropriate evacuation actions while taking into account the user's emotional state, and provide an environment in which users can act with peace of mind even in the event of a disaster.

[0408] Prompt Sentence Examples

[0409] An example of information that a user might enter into a terminal is the prompt:

[0410] "If an emergency earthquake alert is received, please tell me the nearest evacuation shelter."

[0411] "I'm feeling stressed. I'd like some advice on how to relax."

[0412] "The evacuation route is congested. Please tell me an alternative route."

[0413] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0414] Step 1: Data collection

[0415] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources using APIs.

[0416] Input: Data obtained from an API endpoint (e.g., the Japan Meteorological Agency's earthquake information API)

[0417] Data processing: Parse the JSON format data obtained from the API and extract the necessary information.

[0418] Output: Formatted data objects for earthquakes, weather, traffic, evacuation shelters, etc.

[0419] Specific operation: Use an HTTP client such as curl to periodically retrieve data, and then use a Python script to parse and save the JSON data.

[0420] Step 2: Data analysis

[0421] The server analyzes the collected data in real time and predicts the extent of the disaster's impact and damage.

[0422] Input: Formatted data objects (earthquake, weather, traffic, evacuation shelter data)

[0423] Data calculation: Based on the acquired data, a damage prediction algorithm is run to calculate the extent of impact and risk level.

[0424] Output: Damage prediction data object (e.g., collapse risk assessment by region)

[0425] Specific operation: Using Python libraries (pandas and numpy), damage prediction models are executed and risk assessments are performed.

[0426] Step 3: Generate individual support information

[0427] The server generates individual evacuation instructions and support information based on the user's personal information and location information.

[0428] Input: Damage prediction data object, user's personal information and location information

[0429] Data processing: Identify target areas based on user information and generate evacuation instructions for those areas.

[0430] Output: Evacuation instruction message for each user

[0431] Specific operation: An SQL query is used to extract the user's address information, and the shelter information corresponding to that address is retrieved from the database to generate a message.

[0432] Step 4: Send notification

[0433] The server notifies the user device of the generated analysis results and evacuation instructions in real time.

[0434] Input: User-specific evacuation instruction message

[0435] Data Calculation: Converts the message into notification format and prepares it for transmission.

[0436] Output: Push notification to user device

[0437] Specific operation: The analysis results are sent as a push notification using the Firebase Cloud Messaging (FCM) API.

[0438] Step 5: Receive notifications

[0439] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[0440] Input: Push notification received from FCM

[0441] Data processing: Analyzes received notifications and triggers visual and audio alerts.

[0442] Output: A notification message that is displayed to the user.

[0443] What it does: An Android app overrides the onMessageReceived method to display notifications and, if the notification is important, trigger an audio alert.

[0444] Step 6: Display information

[0445] The terminal displays the received information to the user in an easy-to-understand format.

[0446] Input: Parsed notification message

[0447] Data processing: Formatting the data required to display the information visually.

[0448] Output: Map display of evacuation routes and shelters

[0449] Specific operation: Uses the Google Maps API to display evacuation routes and shelter locations on a map.

[0450] Step 7: Emotional State Monitoring

[0451] The device monitors the user's emotional state in real time.

[0452] Input: User facial expression data obtained from the device's camera

[0453] Data calculation: Analyze facial expression data and determine emotional state.

[0454] Output: User's emotional state data

[0455] Specific operation: Using OpenCV and dlib libraries, facial expression analysis is performed to determine the user's emotional state.

[0456] Step 8: Emotional State Report

[0457] The terminal transmits the user's emotional state to the server.

[0458] Input: Parsed emotional state data

[0459] Data processing: Emotion data is formatted to be sent to the server.

[0460] Output: Emotional state data sent to the server

[0461] Specific operation: Emotion data is sent to the server using an HTTP POST request.

[0462] Step 9: Two-way communication

[0463] The terminal transmits the feedback from the user to the server.

[0464] Input: User-entered feedback information

[0465] Data processing: The feedback information is formatted to be sent to the server.

[0466] Output: Feedback information sent to the server

[0467] What it does: When you press a button in the app, feedback information is sent to the server using an HTTP POST request.

[0468] Step 10: Emergency response

[0469] Users can quickly take evacuation action by following the notifications on their devices.

[0470] Input: Emergency notification received from the device

[0471] Action: Follow the instructions on the device and quickly move to a shelter.

[0472] Output: Move to safe shelter

[0473] Specific actions: Check the evacuation route displayed on the device screen and follow the instructions to move to the evacuation shelter.

[0474] Step 11: Report evacuation completion

[0475] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[0476] Input: User action upon arrival at the evacuation shelter (pressing the evacuation completion button)

[0477] Action: Press the evacuation complete button to report to the server.

[0478] Output: Evacuation completion is reported to the server

[0479] Specific operation: After arriving at the evacuation shelter, press the "Evacuation Complete" button in the app to send the information to the server.

[0480] Through these processing steps, the system of the present invention can support quick and appropriate evacuation actions while taking into account the user's emotional state, and provide an environment in which users can act with peace of mind even in the event of a disaster.

[0481] (Application example 2)

[0482] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0483] In modern society, when a natural disaster occurs, users, especially those staying in physical stores, are required to take prompt and appropriate evacuation actions. However, many users panic during a disaster and find themselves in situations where it is difficult to make calm decisions. In addition, existing disaster information systems only provide general notifications and lack individualized support tailored to each user's situation and emotional state. Therefore, a comprehensive support system is needed to enable users to evacuate efficiently and take appropriate actions.

[0484] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting data, means for analyzing the collected data, means for notifying the user device of the analysis results in real time, means for the user device to notify the user of evacuation routes and evacuation instructions in real time in the event of a disaster, and means for the user device to monitor the user's emotional state and provide advice to support evacuation behavior. This not only enables the user to take prompt and appropriate evacuation behavior in the event of a disaster, but also allows the user's emotional state to be monitored in real time and receive appropriate advice as needed.

[0485] "Means of collecting data" refers to systems or equipment for obtaining information from outside on earthquakes, weather, traffic, evacuation shelters, etc.

[0486] "Means for analyzing collected data" refers to software and algorithms that examine the acquired data and predict the extent of the disaster's impact and damage.

[0487] "Means for notifying the user device of analysis results in real time" refers to communication technologies and protocols for quickly transmitting analyzed information to the user's device.

[0488] "A means for user devices to notify users of evacuation routes and evacuation instructions in real time during a disaster" refers to an application that allows users' smartphones and other devices to display the optimal evacuation routes and evacuation instructions in an emergency.

[0489] "Means for user devices to monitor the user's emotional state and provide advice to assist with evacuation behavior" refers to a function in which the device detects the user's facial expressions and behavior and displays advice such as relaxation methods depending on the situation.

[0490] "Means for registering users' personal information in normal times" refers to an interface that allows users to register personal information such as addresses and contact details when no disaster is occurring.

[0491] "Means for providing individual evacuation instructions based on the user's registered information in an emergency" refers to a system that generates and provides appropriate evacuation instructions based on the user's personal information in the event of a disaster.

[0492] "Means for reporting the user's evacuation status to the server" refers to a communication function for informing the server that the user has completed evacuation actions.

[0493] "Means for the server to assess risk levels and generate evacuation instructions in the event of a disaster" refers to the function for the server to analyze collected data, assess disaster risks, and generate appropriate evacuation instructions.

[0494] "Means for analyzing a user's emotional data and generating support information based on their emotional state" refers to algorithms and software that analyze a user's emotional data and generate support information such as stress relief.

[0495] "Means for regularly updating the latest evacuation information" refers to a function that regularly obtains the latest evacuation-related data and reflects it on the user's device.

[0496] "Means for a device to receive emergency notifications from a server and display them to the user" refers to technology that allows a device to receive alerts and information sent from a server and notify the user visually and audibly.

[0497] "Means for transmitting user feedback to the server" refers to a communication function for transmitting information provided by the user regarding the evacuation situation and emotional state to the server.

[0498] "Means for monitoring the user's emotional state and reporting it to the server" refers to technology that enables the device to detect the user's emotions in real time and communicate that state to the server.

[0499] "Means for a user device to suggest relaxation methods to a user" refers to a function that allows a user device to suggest advice or methods for relaxing based on the user's stress level or emotional state.

[0500] This invention relates to an evacuation support system that supports users in taking prompt and appropriate evacuation actions in the event of a disaster at a physical store. In particular, it focuses on the function of monitoring the user's emotional state in real time and providing support information based on the user's emotions. The specific system configuration and operation are described below.

[0501] Server Processing

[0502] The server has a configuration including the following means:

[0503] 1. Data collection method: The server periodically collects data from external sources such as earthquakes, weather, traffic, and evacuation shelters. For this purpose, it uses APIs from the Japan Meteorological Agency.

[0504] 2. Data analysis method: Analyze the acquired data to predict the extent of the disaster impact and damage, and evaluate the risk level.

[0505] 3. Notification method: Analysis results are notified to the user device in real time.

[0506] 4. Emotional data analysis means: Analyzes the user's emotional data and generates individual evacuation instructions and support information based on their emotional state.

[0507] Terminal handling

[0508] The user device (e.g., a smartphone) comprises the following means:

[0509] 1. Notification receiving means: Receives notifications from the server and notifies the user via push notifications or voice alerts.

[0510] 2. Information display method: Received evacuation information and action advice are displayed in an easy-to-understand manner to the user.

[0511] 3. Emotional state monitoring: Monitor the user's emotional state in real time and provide advice to calm the emotions as needed.

[0512] 4. Emotional state reporting means: The emotional state of the user detected using the emotion engine is sent to the server.

[0513] 5. Feedback transmission means: Sends feedback about the user's evacuation situation and emotions to the server.

[0514] User behavior

[0515] 1. Initial setup: Users register their personal information during normal times and store it on their devices. This allows them to receive prompt and appropriate assistance in the event of a disaster.

[0516] 2. Emergency response: Users can quickly take evacuation action according to notifications on their devices and calm down by following the advice on their devices.

[0517] 3. Reporting evacuation completion: Once the user has completed the evacuation, they can report it by pressing the evacuation completion button on their device.

[0518] Hardware and Software Used

[0519] Server: Web server using Flask

[0520] Device: iOS or Android device

[0521] Data collection source: Japan Meteorological Agency API, etc.

[0522] Specific examples

[0523] Scenario: Evacuation support immediately after an earthquake occurs at a brick-and-mortar store

[0524] 1. The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the store area.

[0525] 2. The app receives risk information and evacuation instructions from the server and sends push notifications to customers in the store.

[0526] 3. The customer checks the notice and evacuates by following the instructed safe evacuation route.

[0527] 4. The app monitors the customer's emotional state and displays relaxation suggestions if they are feeling anxious.

[0528] Prompt Sentence Examples

[0529] "Get earthquake information from the Japan Meteorological Agency and analyze the risk level. Create a Python Flask application that provides optimal evacuation advice to users based on the results."

[0530] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0531] Step 1: Data collection

[0532] The server collects data from external sources such as earthquakes, weather, traffic, and evacuation shelters through APIs. The input data is the latest disaster information received from the API, and the output data is unprocessed disaster data stored in the server. In this process, the server periodically calls the API to obtain and store the latest information.

[0533] Step 2: Data analysis

[0534] The server analyzes the collected data to assess the scope of the disaster impact and the risk level. The input data is the raw disaster data collected in step 1, and the output data is the analyzed risk assessment results. In this process, the server evaluates the data using an analysis algorithm and determines the risk level.

[0535] Step 3: Generate notifications

[0536] The server generates appropriate evacuation instructions based on the analysis results and notifies the user device. The input data is the risk assessment result obtained in step 2, and the output data is the evacuation instructions to be sent to the user device. In this process, the server generates appropriate evacuation advice and prepares it for notification to the user device.

[0537] Step 4: Receive notifications

[0538] The device receives notifications sent from the server and notifies the user via push notifications or voice alerts. The input data is the evacuation instructions sent from the server, and the output data is the push notification or voice alert received by the user. In this process, the device receives the notification via a communication protocol and displays it to the user.

[0539] Step 5: Display information

[0540] The device receives evacuation information and action advice and displays it in an easy-to-understand manner to the user. The input data is evacuation instructions from the server, and the output data is evacuation routes and instructions that the user can visually confirm on the device. In this process, the device displays evacuation information on the screen, and the user confirms the information.

[0541] Step 6: Emotional State Monitoring

[0542] The device monitors the user's emotional state in real time and provides advice to calm the user as needed. The input data is real-time data on the user's facial expressions and behavior, and the output data is suggested relaxation methods. In this process, the device uses cameras and sensors to detect the user's emotions and displays appropriate advice.

[0543] Step 7: Emotional State Report

[0544] The device transmits the user's emotional state detected using the emotion engine to the server. The input data is the user's emotional data obtained in step 6, and the output data is the emotional state information to be transmitted to the server. In this process, the device transfers the emotional data to the server via a communication protocol.

[0545] Step 8: Send your feedback

[0546] The device sends user feedback to the server. The input data is the evacuation completion report and emotional feedback from the user, and the output data is the feedback information to be sent to the server. In this process, the user inputs feedback through the device interface, and the device sends it to the server.

[0547] Through these steps, a system will be realized that allows users to take prompt and appropriate evacuation actions in the event of a disaster and receive support according to their emotions.

[0548] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0549] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0550] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0551] [Second embodiment]

[0552] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0553] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0554] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0555] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0556] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0557] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0558] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0559] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0560] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0561] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0562] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0563] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0564] This paper describes a system that collects data, analyzes it, and notifies the results to user devices in real time. The system is intended to support evacuation in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[0565] Server Processing

[0566] 1. Data Collection

[0567] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[0568] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[0569] 2. Data Analysis

[0570] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[0571] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[0572] 3. Individual support information generation

[0573] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[0574] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[0575] 4. Notification sending

[0576] The server notifies the user device of analysis results and evacuation instructions in real time.

[0577] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[0578] Terminal handling

[0579] 1. Receiving notifications

[0580] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[0581] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[0582] 2. Information display

[0583] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[0584] - Example: The device displays the safest evacuation route on a map.

[0585] 3. Two-way communication

[0586] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[0587] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[0588] User behavior

[0589] 1. Initial Setup

[0590] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[0591] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[0592] 2. Emergency Response

[0593] Users can quickly take evacuation action by following the notifications on their devices.

[0594] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[0595] 3. Reporting completion of evacuation

[0596] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[0597] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[0598] Specific examples

[0599] 1. Scenario: Evacuation immediately after an earthquake occurs

[0600] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[0601] - The device receives evacuation warnings from the server and notifies the user via push notification.

[0602] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[0603] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[0604] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" helps users take swift and appropriate evacuation actions. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operations are described in detail in the processing steps below.

[0605] The processing flow will be explained below.

[0606] Step 1: Initial Setup (Normal)

[0607] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information, etc.).

[0608] Step 2: Upload your information

[0609] The terminal sends the information entered by the user to the server, and the terminal uploads the user data to the server using a secure communication protocol (e.g., HTTPS).

[0610] Step 3: Update the database

[0611] The server stores the received information in a database. The server creates a new user entry in the database and stores the personal information.

[0612] Step 4: Periodic data collection

[0613] The server periodically collects data from various sources, such as the Japan Meteorological Agency API, traffic information API, and evacuation shelter information API.

[0614] Step 5: Analyze and save

[0615] The server analyzes the collected data and stores the necessary information in a database. The server also stores new earthquake risk assessments and evacuation shelter status information.

[0616] Step 6: Update information

[0617] The device periodically retrieves data from the server and stores it in local storage. The device queries the server daily or at a specified frequency and stores the latest information locally.

[0618] Step 7: Obtain emergency information

[0619] The server immediately obtains earthquake occurrence information. The server receives immediate notification when an earthquake occurs via the Japan Meteorological Agency's real-time API.

[0620] Step 8: Real-time analysis

[0621] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity and impact area of ​​the earthquake and identify areas where evacuation warnings are required.

[0622] Step 9: Generate notifications

[0623] The server generates evacuation advisory notices based on the analysis results. The server creates notices for highly affected areas that include specific evacuation instructions and information on safe evacuation routes.

[0624] Step 10: Send emergency notifications

[0625] The server sends an emergency notification to the device. The server uses a push notification service (e.g., Firebase Cloud Messaging) to send the emergency notification to the user's device in real time.

[0626] Step 11: Receiving and viewing notifications

[0627] The device receives the emergency notification from the server and displays it to the user. The device notifies the user of the emergency information using a voice alert or push notification.

[0628] Step 12: Check evacuation instructions

[0629] The user checks the notification on the device and begins the specified evacuation action. The user then checks the evacuation route and location information of the evacuation shelter on the device screen.

[0630] Step 13: Evacuation

[0631] The user follows the evacuation route indicated by the device and moves to a safe location. The user heads to the designated evacuation shelter using the map and route information displayed on the device as a reference.

[0632] Step 14: Evacuation completion report

[0633] When the user has completed evacuation, they press the evacuation completion button on their device. When the user arrives at the evacuation shelter, they tap the evacuation completion button in the app.

[0634] Step 15: Submitting the completed information

[0635] The terminal sends an evacuation completion report to the server. The terminal sends the evacuation completion information to the server along with the user's location data.

[0636] Step 16: Database Update

[0637] The server stores the evacuation completion information in a database and manages the evacuation situation. The server updates the evacuation situation map in real time based on the received evacuation completion data.

[0638] Example 1

[0639] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0640] In modern society, rapid and accurate information provision and evacuation instructions are required when a disaster occurs. However, conventional systems can be slow in collecting and analyzing information, making it difficult for users to take appropriate evacuation actions. Another problem is that support tailored to each user's individual situation is not provided adequately. In particular, it has been technically difficult to provide analysis results and issue individual evacuation instructions in real time. There is a need for a system that can solve these issues.

[0641] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0642] In this invention, the server includes a means for collecting information, a means for analyzing the collected information, and a means for notifying a user terminal of the analysis results in real time. This allows users to receive prompt and accurate information and take appropriate evacuation actions. The server also includes a means for collecting information from various sources in an emergency, a means for predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users, a means for registering personal information of users in normal times, a means for generating individual evacuation instructions and support information in the event of a disaster, and a means for reporting the user's status to the server, thereby providing support tailored to each user's individual situation. Furthermore, the user terminal includes a means for receiving emergency notifications from the server and presenting them to the user, a means for transmitting user feedback to the server, and a means for periodically updating the user terminal with the latest evacuation information. This allows users to always receive the latest and most reliable information and encourage appropriate evacuation actions.

[0643] - "Means of collecting information" refers to the system for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[0644] "Means for analyzing collected information" refers to algorithms and software that use the acquired data to predict the extent of the disaster's impact and damage.

[0645] "Means for notifying the user terminal of the analysis results in real time" refers to a communication means for instantly transmitting the analyzed data to the user's device.

[0646] "A means of predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users" is a system for assessing the impact of a disaster when it occurs and instructing users on the most appropriate course of action.

[0647] "Means for registering users' personal information in peacetime" refers to a system for registering personal information such as users' addresses and emergency contact details before a disaster occurs.

[0648] "Means for generating individual evacuation instructions and support information in the event of a disaster" refers to a system that provides information on appropriate evacuation routes and evacuation locations in the event of a disaster, based on information registered in advance by the user.

[0649] "Means for reporting the user's status to the server" refers to a communication means for transmitting the user's current location and evacuation status to the server, and for the server to grasp this information.

[0650] "Means for the user terminal to receive emergency notifications from the server and present them to the user" refers to a mechanism by which the user's device receives emergency information sent from the server and provides feedback to the user.

[0651] "Means for sending user feedback to the server" refers to a mechanism for sending information and status reports provided by users to the server.

[0652] "Means for regularly updating the latest evacuation information to user devices" refers to a system that regularly delivers the latest evacuation information to users' devices and keeps the information up to date.

[0653] This invention relates to a system that provides evacuation instructions and support information quickly and accurately in the event of an emergency such as a natural disaster. This system is composed of three main elements: a server, terminals, and users, each of which fulfills a specific role to function as a whole.

[0654] Server embodiment

[0655] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources. This data is collected using Python scripts that retrieve information from external data providers such as the Japan Meteorological Agency's API. The data obtained is in JSON format and stored in the server's database.

[0656] The server then analyzes the collected data in real time. It uses Python libraries such as Pandas and NumPy to create data frames, and uses statistical processing and machine learning models to predict the extent of the disaster's impact and damage. The analysis results are then used to generate appropriate evacuation instructions for users.

[0657] Furthermore, the server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times. Specifically, it uses the Geopandas library to identify the nearest evacuation shelter and safe evacuation route from the user's address information using GIS data.

[0658] Finally, the server notifies the user device in real time of the analysis results and evacuation instructions using Firebase Cloud Messaging (FCM), and the server calls the FCM API to send push notifications.

[0659] Terminal embodiment

[0660] The device receives notifications from the server and notifies the user via push notifications or voice alerts. For example, on Android devices, notifications are received using Firebase's notification manager. If an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency alert.

[0661] The device also displays the received evacuation and support information in an easy-to-understand manner to the user. By using the Google Maps API, evacuation routes are visually displayed on a map, allowing users to easily check their evacuation routes.

[0662] The device also sends user feedback to the server, allowing the server to understand the user's current location and evacuation status in real time and provide additional assistance information as needed.When the user presses the evacuation completion button, the device sends an HTTP request to the server, updating the status in the database.

[0663] User's embodiment

[0664] Users register their personal information with the application during normal times, including their name, address, emergency contact information, etc. This information is stored on the device and securely transferred to the server when necessary.

[0665] When an emergency occurs, the user quickly takes evacuation action according to the notification from the device. For example, the user checks the notification on the device and moves to a safe shelter according to the evacuation route displayed. After completing the evacuation, the user presses the evacuation completion button on the device to report to the server.

[0666] Specific examples

[0667] Example prompt:

[0668] "Please tell me the evacuation route immediately after an earthquake occurs. Please suggest the optimal evacuation route based on the information obtained from the server."

[0669] In response to such prompts, the system generates the optimal evacuation route in real time based on the user's current location and information on the nearest evacuation shelter, and notifies the user. The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area, and the device receives evacuation advisories from the server and notifies the user via push notification. The user checks the notification on their device, takes the specified evacuation action, and after arriving at the evacuation shelter, presses the evacuation completion button to report to the server.

[0670] As a result, the system of the present invention can provide prompt and accurate evacuation support in the event of a disaster, thereby minimizing damage.

[0671] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0672] Step 1: Gather information

[0673] Input: Real-time data provided by APIs from external sources (such as the Japan Meteorological Agency and traffic information providers)

[0674] Specific operation: The server periodically executes a Python script and sends requests to the Japan Meteorological Agency's API, which retrieves data in JSON format, such as earthquake, weather, traffic, and evacuation shelter information. The server automatically collects this data and stores it in a database.

[0675] Output: Various disaster-related data stored in the database

[0676] Step 2: Data analysis

[0677] Input: Collected data stored in a database

[0678] Specific operation: The server uses Python's Pandas and NumPy libraries to create a data frame. Based on this, statistical processing and machine learning models are applied to predict the extent of the disaster impact and damage. For example, earthquake data is analyzed to calculate the epicenter, magnitude, and damage forecast.

[0679] Output: Analysis results (e.g., risk of building collapse in a specific area, evacuation advisories)

[0680] Step 3: Generate personalized support information

[0681] Input: User's registered personal information (address, emergency contact, etc.) and analysis results

[0682] Specific operation: The server uses the user's personal information acquired during normal times to identify the best evacuation shelter and safe evacuation route using libraries such as Geopandas. For example, it searches for the nearest evacuation shelter based on the user's address information and generates a route to that shelter.

[0683] Output: Individual evacuation instructions and support information (e.g., evacuation shelter list, evacuation route)

[0684] Step 4: Send notification

[0685] Input: Individual evacuation instructions and support information

[0686] Specific operation: The server uses Firebase Cloud Messaging (FCM) to send notifications to the user's device in real time. It calls the FCM API and sends appropriate evacuation warnings and route information to the user via push notifications.

[0687] Output: Evacuation notification sent to user device

[0688] Step 5: Receive notifications

[0689] Input: Notification sent from the server

[0690] Specific operation: The device receives notifications from the FCM and displays alerts and push notifications to the user. For example, if an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency notification to the user.

[0691] Output: Urgent notification displayed on the user's screen

[0692] Step 6: Display information

[0693] Input: Received evacuation instructions and assistance information

[0694] How it works: The device uses the Google Maps API to visually display evacuation routes, allowing users to identify safe evacuation routes and the location of evacuation shelters.

[0695] Output: Evacuation route and shelter information displayed on the device screen

[0696] Step 7: Two-way communication

[0697] Input: User feedback (e.g., information on pressing the evacuation complete button)

[0698] Specific operation: When a user arrives at a shelter and presses the "Evacuation Complete" button on their device, that information is sent to the server as an HTTP request. The server receives this information and updates the database.

[0699] Output: Evacuation completion information sent to the server

[0700] Step 8: Initial Setup

[0701] Input: User's personal information (name, address, emergency contact, etc.)

[0702] Specific operation: The user enters the necessary information on the app's settings screen, which is saved on the device. The data is then transferred to the server via secure communication and registered in the database.

[0703] Output: Personal information of registered users

[0704] Step 9: Emergency response

[0705] Input: Evacuation information received from the server

[0706] Specific actions: The user checks the notification on the device and takes prompt action to evacuate by following the displayed evacuation route. Specifically, the user follows the evacuation route on the map and moves to a safe evacuation shelter.

[0707] Output: User's evacuation behavior

[0708] Step 10: Evacuation completion report

[0709] Input: User's evacuation completion operation (pressing the evacuation completion button)

[0710] Specific operation: When the user arrives at the evacuation shelter and presses the evacuation completion button, the device sends the information to the server. The server receives this report and updates the database to record the evacuation completion status.

[0711] Output: Evacuation completion information recorded on the server

[0712] (Application example 1)

[0713] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0714] To enable autonomous vehicles and other mobile devices to evacuate quickly and efficiently in the event of a disaster, a system is needed that can obtain disaster information in real time, provide optimal evacuation routes, and automatically follow those routes. It is also necessary to grasp the user's evacuation status in real time and provide additional assistance. Conventional systems do not integrate these functions, making it difficult for users to evacuate quickly and effectively.

[0715] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0716] In this invention, the server includes a means for collecting data, a means for analyzing the collected data, and a means for notifying the user device of the analysis results in real time. This enables real-time acquisition and analysis of disaster information and provision of optimal evacuation routes during disasters. Furthermore, this invention also includes a means for displaying optimal evacuation routes for mobile objects based on the analysis results, and a means for the mobile object to automatically move along the evacuation route. This enables self-driving vehicles and other mobile objects to evacuate quickly and efficiently.

[0717] "Means of collecting data" refers to systems and methods for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[0718] "Means for analyzing collected data" refers to systems and methods for analyzing acquired data and predicting the extent of the impact and damage of a disaster.

[0719] "Means for notifying a user device of analysis results in real time" refers to a system or method for instantly delivering and notifying a user device of analysis results.

[0720] "Means for displaying the optimal evacuation route for a moving object based on the analysis results" refers to a system or method for presenting the optimal evacuation route for a moving object based on analyzed evacuation information.

[0721] "Means for a mobile body to automatically move along an evacuation route" refers to a system or method in which a mobile body automatically operates along a presented optimal evacuation route.

[0722] "Means for registering users' personal information in peacetime" refers to systems and methods for registering users' personal information in a database before a disaster occurs.

[0723] "Means for providing individual evacuation instructions based on user registration information in an emergency" refers to a system or method that uses user registration information to provide individually customized evacuation instructions in the event of a disaster.

[0724] "Means for reporting the user's evacuation status to the server" refers to a system or method for transmitting and reporting the user's evacuation status to the server.

[0725] "Means for monitoring evacuation situations in real time and providing additional support information" refers to a system or method for monitoring a user's evacuation situation in real time and providing any additional support that is required.

[0726] "Means for regularly updating the latest evacuation information to the user's device" refers to a system or method for regularly updating the latest evacuation information to the user's device.

[0727] "Means for a device to receive an emergency notification from a server and display it to a user" refers to a system or method in which a device receives an emergency message from a server and displays an alert to a user.

[0728] "Means for transmitting user feedback to a server" refers to a system or method for transmitting user-provided information or feedback to a server.

[0729] "Means for notifying the server of the evacuation completion status of a mobile body in an emergency" refers to a system or method for reporting to the server that the evacuation of a mobile body has been completed in an emergency.

[0730] This invention is a system that supports autonomous vehicles and other mobile objects to evacuate quickly and efficiently in the event of a disaster. Here, we will explain the roles of the server, terminal, and user, as well as the specific implementation method of the entire system.

[0731] Server Processing

[0732] 1. Data Collection

[0733] The server periodically obtains data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources using APIs. This process is achieved using a programming language such as Python and a library for making HTTP requests (e.g., requests).

[0734] 2. Data Analysis

[0735] The collected data is analyzed in real time to predict the extent of the disaster impact and damage. This is done using machine learning models and data analysis libraries (e.g., scikit-learn). Based on the analysis results, the optimal evacuation route is calculated.

[0736] 3. Sending notifications

[0737] The analysis results are sent to the user's device in real time using a push notification service (e.g., Firebase Cloud Messaging).

[0738] Terminal handling

[0739] 1. Receiving notifications

[0740] The terminal receives notifications from the server and notifies the user via push notifications or audio alerts. This role is played by user devices such as smartphones or head-mounted displays (HUDs).

[0741] 2. Information display

[0742] The device will then display the received evacuation information in an easy-to-understand manner. In particular, the HUD of the autonomous vehicle will display evacuation routes. This will be done using a map display library (e.g., Google Maps API).

[0743] 3. Two-way communication

[0744] The device sends user feedback to a server and monitors the evacuation situation in real time, allowing it to provide additional assistance if needed.

[0745] User Behavior

[0746] 1. Initial Setup

[0747] Users register their personal information in normal times using a smartphone app or web interface.

[0748] 2. Emergency Response

[0749] Users receive notifications from their devices and follow instructions to quickly take evacuation action. In the case of autonomous vehicles, the vehicles will automatically begin moving along the evacuation route provided.

[0750] 3. Reporting completion of evacuation

[0751] When the user arrives at the evacuation shelter, they press the evacuation completion button on their device to report to the server. This information is used to appropriately plan the next evacuation measures.

[0752] Specific examples

[0753] For example, if an earthquake occurs while a user is in an autonomous vehicle, the system immediately obtains the latest disaster information and calculates and displays the optimal evacuation route. The autonomous vehicle then automatically begins driving and continues to a safe evacuation shelter. After arriving at the evacuation shelter, the user can use their device to report the completion of evacuation to the server, and the server can use that information to provide additional assistance.

[0754] Prompt Sentence Examples

[0755] "Design an application that provides detailed earthquake information, calculates and displays the route from your current location to the best evacuation shelter, and includes a function that allows an autonomous vehicle to automatically evacuate by following that route."

[0756] The above is a specific embodiment of the disaster evacuation support system of the present invention, which enables users to evacuate quickly and efficiently based on real-time disaster information.

[0757] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0758] Processing steps and specific operations

[0759] Step 1:

[0760] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources via API. Specifically, it sends HTTP requests to API endpoints such as those of the Japan Meteorological Agency and traffic information providers, and obtains the returned JSON data. This collected data becomes the input for processing and is stored internally on the server.

[0761] Step 2:

[0762] The server analyzes the collected data in real time, using machine learning generative AI models and data analysis libraries (e.g., scikit-learn). The purpose of the analysis is to predict the extent of the disaster's impact and damage, using collected weather and earthquake information as input data, and then outputting specific analysis results such as evacuation routes.

[0763] Step 3:

[0764] The server then sends real-time evacuation information to the user device based on the analysis results. This notification is sent using a push notification service (e.g., Firebase Cloud Messaging). Specifically, the server formats the analysis results and sends a push notification specifying the user device's identifier. During this process, the notification content is generated as output data.

[0765] Step 4:

[0766] The device receives the notification sent from the server and notifies the user. Specifically, a smartphone or head-mounted display (HUD) receives a push notification and displays it to the user as an audio alert or a pop-up on the screen. This notification becomes input data and is output in the form of an alert display.

[0767] Step 5:

[0768] The device displays the optimal evacuation route to the user. A map display library (e.g., Google Maps API) is used to display the evacuation route. After receiving the push notification, the device obtains the evacuation route information as an analysis result and displays it on the device screen or HUD. The input of this process is the notification from the server, and the output is a visual representation of the evacuation route.

[0769] Step 6:

[0770] The autonomous vehicle automatically begins moving according to the displayed evacuation route. The vehicle's autonomous driving system manages this process and generates the control signals necessary to operate according to the evacuation route. The input is the evacuation route information, and the output is the movement of the vehicle.

[0771] Step 7:

[0772] The device reports the user's evacuation completion status to the server. Specifically, when the user arrives at the evacuation shelter and presses the evacuation completion button on the device, a message indicating evacuation completion is sent to the server. The input is the user's operation, and the output is the report data.

[0773] Step 8:

[0774] The server receives the evacuation completion report and provides additional support information as needed. This support information is generated using a generative AI model based on the latest situation and notified to the user device. The input is the evacuation completion report data, and the output is the support information.

[0775] Through the above processing steps, the disaster evacuation support system of the present invention supports mobile bodies, including autonomous vehicles, in taking evacuation actions quickly and efficiently.

[0776] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0777] This invention combines a system that collects data, analyzes it, and notifies the user device of the results in real time with an emotion engine that recognizes the user's emotions and provides evacuation instructions and support information based on those emotions. The aim is to help users receive appropriate information and take swift and calm evacuation action, particularly in the event of a disaster. The system consists of three main elements: a server, a terminal, and a user, to which the emotion engine is added.

[0778] Server Processing

[0779] 1. Data Collection

[0780] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[0781] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[0782] 2. Data Analysis

[0783] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[0784] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[0785] 3. Individual support information generation

[0786] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[0787] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[0788] 4. Notification sending

[0789] The server notifies the user device of analysis results and evacuation instructions in real time.

[0790] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[0791] 5. Emotional Data Analysis

[0792] The server analyzes the data from the emotion engine and generates additional support information and advice based on the user's emotional state.

[0793] - Example: The server provides advice on how to relax if the user is feeling stressed.

[0794] Terminal handling

[0795] 1. Receiving notifications

[0796] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[0797] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[0798] 2. Information display

[0799] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[0800] - Example: The device displays the safest evacuation route on a map.

[0801] 3. Emotional state monitoring

[0802] The device monitors the user's emotional state in real time and provides advice and messages to calm the emotions as needed.

[0803] - Example: The device can recognize the user's facial expressions and suggest relaxation techniques if they are feeling anxious.

[0804] 4. Emotional State Report

[0805] The device uses an emotion engine to detect the user's emotional state and transmits it to the server.

[0806] - Example: The device sends information about the user's stress to the server.

[0807] 5. Two-way communication

[0808] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[0809] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[0810] User behavior

[0811] 1. Initial Setup

[0812] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[0813] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[0814] 2. Emergency Response

[0815] Users can quickly take evacuation action by following notifications on their device, and calm down by following advice on the device.

[0816] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[0817] 3. Reporting completion of evacuation

[0818] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[0819] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[0820] Specific examples

[0821] 1. Scenario: Evacuation immediately after an earthquake occurs

[0822] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[0823] - The device receives evacuation warnings from the server and notifies the user via push notification.

[0824] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[0825] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[0826] - The device monitors the user's emotional state and provides relaxation advice if they are feeling stressed.

[0827] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" supports swift and appropriate evacuation actions while taking into account the user's emotional state. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operation are described in detail in the processing steps below.

[0828] The processing flow will be explained below.

[0829] Step 1: User Registration

[0830] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information).

[0831] Step 2: Send information

[0832] The device sends the information entered by the user to the server. The device transmits the data securely using HTTPS.

[0833] Step 3: Update the database

[0834] The server stores the received user information in a database. The server creates a new user entry and stores the personal information securely.

[0835] Step 4: Data collection during normal times

[0836] The server periodically collects earthquake information, weather information, traffic information, evacuation shelter information, etc. from related organizations. The server obtains the latest information using API.

[0837] Step 5: Data analysis during normal times

[0838] The server analyzes the collected data and stores the necessary information in a database. The server updates the database with new risk assessments and shelter status information.

[0839] Step 6: Update information

[0840] The device retrieves data from the server and stores it in local storage. The device queries the server at a specified frequency and downloads the latest information.

[0841] Step 7: Obtain emergency information

[0842] The server obtains earthquake occurrence information in real time. The server receives earthquake information via the Japan Meteorological Agency's real-time API.

[0843] Step 8: Real-time data analysis

[0844] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity and impact area, and identifies areas where evacuation orders are required.

[0845] Step 9: Generate notifications

[0846] The server generates evacuation advisory notices based on the analysis results. The server creates notices that include specific evacuation instructions and evacuation routes.

[0847] Step 10: Send emergency notifications

[0848] The server sends emergency notifications to the device. The server uses a push notification service to send emergency notifications in real time.

[0849] Step 11: Receiving and viewing notifications

[0850] The device receives the emergency notification and notifies the user. The device notifies the user of the emergency information via voice alerts or push notifications.

[0851] Step 12: Check evacuation instructions

[0852] The user confirms the notification and begins the specified evacuation action. The user checks the evacuation route and evacuation shelter information on the device screen.

[0853] Step 13: Emotional State Monitoring

[0854] The device monitors the user's emotional state in real time and evaluates the user's emotions using facial expression recognition and voice analysis.

[0855] Step 14: Sending Emotion Data

[0856] The device sends the data obtained from the emotion engine to the server, and the device periodically reports the user's stress level and emotional state.

[0857] Step 15: Sentiment Data Analysis

[0858] The server analyzes the emotional data and generates support information based on the emotional state. If stress levels are high, the server generates relaxation advice.

[0859] Step 16: Evacuation

[0860] The user follows the evacuation route indicated by the device to a safe location. The user follows the map and route information displayed on the device.

[0861] Step 17: Providing emotional support information

[0862] The device receives the emotional support information from the server and displays it to the user. The device displays a message for stress reduction.

[0863] Step 18: Evacuation completion report

[0864] When the user has completed the evacuation, they press the evacuation completion button on their device. After arriving at the evacuation shelter, the user reports that the evacuation has been completed.

[0865] Step 19: Submit completion information

[0866] The terminal sends a report of completion of evacuation to the server. The terminal also sends information about arrival at the evacuation shelter to the server.

[0867] Step 20: Update the database

[0868] The server stores the evacuation completion information in a database and manages the evacuation situation. The server updates the evacuation situation map in real time.

[0869] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" utilizes an emotion engine to support quick and appropriate evacuation actions while taking into account the user's emotional state, enabling safe and effective evacuation even in a chaotic information environment.

[0870] Example 2

[0871] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0872] Conventional disaster response systems focus on collecting, analyzing, and notifying users of disaster information, but lack the ability to provide evacuation instructions and support information that takes into account the user's emotional state. This makes it difficult for users who are stressed or anxious to take appropriate evacuation actions. Furthermore, they are also inadequate in properly monitoring the user's emotional state in an emergency and providing support based on that state. Therefore, the present invention is required to analyze the user's emotional state in real time and provide appropriate support.

[0873] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for collecting data, a means for analyzing the collected data, a means for notifying the user device of the analysis results in real time, a means for analyzing the emotional state of the user, a means for generating support information based on the emotional state, and a means for notifying the user device of the support information. This enables the user to receive appropriate evacuation instructions and support in real time, taking into account the emotional state, even in the event of a disaster.

[0874] 1. "Means of collecting data" refers to the function for obtaining data on disasters in real time from various sources.

[0875] 2. "Means for analyzing collected data" refers to a function that processes acquired data in real time and predicts the extent of the impact of a disaster and damage.

[0876] 3. "Means for notifying the user device of analysis results in real time" refers to a function for quickly sending and notifying the user device of analysis results.

[0877] 4. "Means for analyzing the user's emotional state" refers to a function for understanding the user's current emotional state by collecting and analyzing emotional data.

[0878] 5. "Means for generating support information based on emotional state" is a function for creating support information and advice appropriate for the user based on the analyzed emotional state.

[0879] 6. "Means for notifying user devices of assistance information" refers to a function for notifying user devices of generated assistance information in real time.

[0880] 7. "Means for registering user personal information during normal times" refers to a function for registering a user's personal information and location in the system when no disaster has occurred.

[0881] 8. "Means for providing individual evacuation instructions based on the user's registered information in an emergency" refers to a function for providing appropriate evacuation instructions to the user in an emergency based on personal information registered in advance.

[0882] 9. "Means for reporting the user's evacuation status to the server" is a function that allows the user to communicate the evacuation status to the server.

[0883] 10. "Means for monitoring the user's emotional state" means a function that monitors the user's emotional state in real time and collects data as necessary.

[0884] 11. "Means for providing emotional support information based on monitoring results" refers to a function for providing support information appropriate to the user in real time based on collected emotional data.

[0885] 12. "Means for periodically updating the latest evacuation information on the user's device" refers to a function for periodically sending and updating the latest evacuation information on the user's device.

[0886] 13. "Means for a terminal to receive an emergency notification from a server and display it to the user" refers to a function that allows a user's terminal to receive an emergency notification sent from a server and display it to the user.

[0887] 14. "Means for sending user feedback to the server" refers to a function for sending information and opinions entered by users to the server.

[0888] 15. "Means for reporting the user's emotional state to the server" means a function for transmitting and reporting data on the user's emotional state to the server.

[0889] This invention combines a system that collects disaster information, analyzes it, and notifies the user device of the results in real time with an emotion engine that recognizes the user's emotions and provides evacuation instructions and support information based on those emotions. The system consists of three main elements: a server, a terminal, and a user, to which an emotion engine is added.

[0890] Server configuration and processing

[0891] The server has the following main functions:

[0892] 1. Data Collection

[0893] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources using APIs.

[0894] Specifically, we use the Japan Meteorological Agency's API and traffic information API. For example, run curl -s http: / / api.weather.go.jp / earthquake to obtain earthquake data.

[0895] 2. Data Analysis

[0896] Using libraries such as Python, the collected data is analyzed in real time, and algorithms are run to estimate damage and the extent of impact in specific areas.

[0897] Example: Using pandas and numpy to process earthquake data and assess the risk of building collapse.

[0898] 3. Individual support information generation

[0899] Individual evacuation instructions and support information are generated based on the personal information and location information of users that have been registered in advance.

[0900] For example, an SQL query can be used to retrieve a user's address information and list information about evacuation shelters in that area.

[0901] 4. Notification sending

[0902] Using Firebase Cloud Messaging (FCM), analysis results and evacuation instructions are sent to user devices in real time.

[0903] Example: Using the FCM API to send an urgent notification via a POST request.

[0904] 5. Emotional Data Analysis

[0905] The data provided by the emotion engine is analyzed to generate additional support information and advice based on the user's emotional state.

[0906] Example: Using an NLP library (e.g., spaCy) to analyze emotion data and generate relaxation advice.

[0907] Terminal configuration and handling

[0908] The terminal has the following main functions:

[0909] 1. Receiving notifications

[0910] Receives emergency notifications sent from the server and notifies the user via push notifications or voice alerts.

[0911] Example: Display a notification using the onMessageReceived method in an Android app.

[0912] 2. Information display

[0913] The received action advice and evacuation information are visually displayed to the user. Evacuation routes and shelters are displayed using a map API.

[0914] Example: Displaying evacuation routes on a map using the Google Maps API.

[0915] 3. Emotional state monitoring

[0916] It uses the device's camera to recognize the user's facial expressions in real time and sends that data to the emotion engine.

[0917] Example: Facial expression recognition using OpenCV and dlib libraries.

[0918] 4. Emotional State Report

[0919] The user's emotional state is periodically transmitted to the server.

[0920] Example: Send emotion data to the server using an HTTP POST request.

[0921] 5. Two-way communication

[0922] User feedback and evacuation status are reported to the server.

[0923] Example: When a user presses the "Evacuation Complete" button, that information is sent to the server via a POST request.

[0924] User Behavior

[0925] The user uses the system as follows:

[0926] 1. Initial Setup

[0927] Register your personal information and emergency contact information in the app during normal times.

[0928] Example: Enter your address and contact information on the settings screen and press the save button.

[0929] 2. Emergency Response

[0930] Follow the notifications on your device to quickly take evacuation action. Move along the evacuation route provided by your device.

[0931] For example: Tap on a notification on your phone to see more information and follow the instructions to a safe haven.

[0932] 3. Reporting completion of evacuation

[0933] Once the evacuation is complete, press the "Evacuation Complete" button on the device to report to the server.

[0934] Example: After arriving at a shelter, press the "Evacuation Complete" button in the app to send the information.

[0935] As a result, the system of the present invention can support quick and appropriate evacuation actions while taking into account the user's emotional state, and provide an environment in which users can act with peace of mind even in the event of a disaster.

[0936] Prompt Sentence Examples

[0937] An example of information that a user might enter into a terminal is the prompt:

[0938] "If an emergency earthquake alert is received, please tell me the nearest evacuation shelter."

[0939] "I'm feeling stressed. I'd like some advice on how to relax."

[0940] "The evacuation route is congested. Please tell me an alternative route."

[0941] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0942] Step 1: Data collection

[0943] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources using APIs.

[0944] Input: Data obtained from an API endpoint (e.g., the Japan Meteorological Agency's earthquake information API)

[0945] Data processing: Parse the JSON format data obtained from the API and extract the necessary information.

[0946] Output: Formatted data objects for earthquakes, weather, traffic, evacuation shelters, etc.

[0947] Specific operation: Use an HTTP client such as curl to periodically retrieve data, and then use a Python script to parse and save the JSON data.

[0948] Step 2: Data analysis

[0949] The server analyzes the collected data in real time and predicts the extent of the disaster's impact and damage.

[0950] Input: Formatted data objects (earthquake, weather, traffic, evacuation shelter data)

[0951] Data calculation: Based on the acquired data, a damage prediction algorithm is run to calculate the extent of impact and risk level.

[0952] Output: Damage prediction data object (e.g., collapse risk assessment by region)

[0953] Specific operation: Using Python libraries (pandas and numpy), damage prediction models are executed and risk assessments are performed.

[0954] Step 3: Generate individual support information

[0955] The server generates individual evacuation instructions and support information based on the user's personal information and location information.

[0956] Input: Damage prediction data object, user's personal information and location information

[0957] Data processing: Identify target areas based on user information and generate evacuation instructions for those areas.

[0958] Output: Evacuation instruction message for each user

[0959] Specific operation: An SQL query is used to extract the user's address information, and the shelter information corresponding to that address is retrieved from the database to generate a message.

[0960] Step 4: Send notification

[0961] The server notifies the user device of the generated analysis results and evacuation instructions in real time.

[0962] Input: User-specific evacuation instruction message

[0963] Data Calculation: Converts the message into notification format and prepares it for transmission.

[0964] Output: Push notification to user device

[0965] Specific operation: The analysis results are sent as a push notification using the Firebase Cloud Messaging (FCM) API.

[0966] Step 5: Receive notifications

[0967] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[0968] Input: Push notification received from FCM

[0969] Data processing: Analyzes received notifications and triggers visual and audio alerts.

[0970] Output: A notification message that is displayed to the user.

[0971] What it does: An Android app overrides the onMessageReceived method to display notifications and, if the notification is important, trigger an audio alert.

[0972] Step 6: Display information

[0973] The terminal displays the received information to the user in an easy-to-understand format.

[0974] Input: Parsed notification message

[0975] Data processing: Formatting the data required to display the information visually.

[0976] Output: Map display of evacuation routes and shelters

[0977] Specific operation: Uses the Google Maps API to display evacuation routes and shelter locations on a map.

[0978] Step 7: Emotional State Monitoring

[0979] The device monitors the user's emotional state in real time.

[0980] Input: User facial expression data obtained from the device's camera

[0981] Data calculation: Analyze facial expression data and determine emotional state.

[0982] Output: User's emotional state data

[0983] Specific operation: Using OpenCV and dlib libraries, facial expression analysis is performed to determine the user's emotional state.

[0984] Step 8: Emotional State Report

[0985] The terminal transmits the user's emotional state to the server.

[0986] Input: Parsed emotional state data

[0987] Data processing: Emotion data is formatted to be sent to the server.

[0988] Output: Emotional state data sent to the server

[0989] Specific operation: Emotion data is sent to the server using an HTTP POST request.

[0990] Step 9: Two-way communication

[0991] The terminal transmits the feedback from the user to the server.

[0992] Input: User-entered feedback information

[0993] Data processing: The feedback information is formatted to be sent to the server.

[0994] Output: Feedback information sent to the server

[0995] What it does: When you press a button in the app, feedback information is sent to the server using an HTTP POST request.

[0996] Step 10: Emergency response

[0997] Users can quickly take evacuation action by following the notifications on their devices.

[0998] Input: Emergency notification received from the device

[0999] Action: Follow the instructions on the device and quickly move to a shelter.

[1000] Output: Move to safe shelter

[1001] Specific actions: Check the evacuation route displayed on the device screen and follow the instructions to move to the evacuation shelter.

[1002] Step 11: Report evacuation completion

[1003] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[1004] Input: User action upon arrival at the evacuation shelter (pressing the evacuation completion button)

[1005] Action: Press the evacuation complete button to report to the server.

[1006] Output: Evacuation completion is reported to the server

[1007] Specific operation: After arriving at the evacuation shelter, press the "Evacuation Complete" button in the app to send the information to the server.

[1008] Through these processing steps, the system of the present invention can support quick and appropriate evacuation actions while taking into account the user's emotional state, and provide an environment in which users can act with peace of mind even in the event of a disaster.

[1009] (Application example 2)

[1010] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1011] In modern society, when a natural disaster occurs, users, especially those staying in physical stores, are required to take prompt and appropriate evacuation actions. However, many users panic during a disaster and find themselves in situations where it is difficult to make calm decisions. In addition, existing disaster information systems only provide general notifications and lack individualized support tailored to each user's situation and emotional state. Therefore, a comprehensive support system is needed to enable users to evacuate efficiently and take appropriate actions.

[1012] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting data, means for analyzing the collected data, means for notifying the user device of the analysis results in real time, means for the user device to notify the user of evacuation routes and evacuation instructions in real time in the event of a disaster, and means for the user device to monitor the user's emotional state and provide advice to support evacuation behavior. This not only enables the user to take prompt and appropriate evacuation behavior in the event of a disaster, but also allows the user's emotional state to be monitored in real time and receive appropriate advice as needed.

[1013] "Means of collecting data" refers to systems or equipment for obtaining information from outside on earthquakes, weather, traffic, evacuation shelters, etc.

[1014] "Means for analyzing collected data" refers to software and algorithms that examine the acquired data and predict the extent of the disaster's impact and damage.

[1015] "Means for notifying the user device of analysis results in real time" refers to communication technologies and protocols for quickly transmitting analyzed information to the user's device.

[1016] "A means for user devices to notify users of evacuation routes and evacuation instructions in real time during a disaster" refers to an application that allows users' smartphones and other devices to display the optimal evacuation routes and evacuation instructions in an emergency.

[1017] "Means for user devices to monitor the user's emotional state and provide advice to assist with evacuation behavior" refers to a function in which the device detects the user's facial expressions and behavior and displays advice such as relaxation methods depending on the situation.

[1018] "Means for registering users' personal information in normal times" refers to an interface that allows users to register personal information such as addresses and contact details when no disaster is occurring.

[1019] "Means for providing individual evacuation instructions based on the user's registered information in an emergency" refers to a system that generates and provides appropriate evacuation instructions based on the user's personal information in the event of a disaster.

[1020] "Means for reporting the user's evacuation status to the server" refers to a communication function for informing the server that the user has completed evacuation actions.

[1021] "Means for the server to assess risk levels and generate evacuation instructions in the event of a disaster" refers to the function for the server to analyze collected data, assess disaster risks, and generate appropriate evacuation instructions.

[1022] "Means for analyzing a user's emotional data and generating support information based on their emotional state" refers to algorithms and software that analyze a user's emotional data and generate support information such as stress relief.

[1023] "Means for regularly updating the latest evacuation information" refers to a function that regularly obtains the latest evacuation-related data and reflects it on the user's device.

[1024] "Means for a device to receive emergency notifications from a server and display them to the user" refers to technology that allows a device to receive alerts and information sent from a server and notify the user visually and audibly.

[1025] "Means for transmitting user feedback to the server" refers to a communication function for transmitting information provided by the user regarding the evacuation situation and emotional state to the server.

[1026] "Means for monitoring the user's emotional state and reporting it to the server" refers to technology that enables the device to detect the user's emotions in real time and communicate that state to the server.

[1027] "Means for a user device to suggest relaxation methods to a user" refers to a function that allows a user device to suggest advice or methods for relaxing based on the user's stress level or emotional state.

[1028] This invention relates to an evacuation support system that supports users in taking prompt and appropriate evacuation actions in the event of a disaster at a physical store. In particular, it focuses on the function of monitoring the user's emotional state in real time and providing support information based on the user's emotions. The specific system configuration and operation are described below.

[1029] Server Processing

[1030] The server has a configuration including the following means:

[1031] 1. Data collection method: The server periodically collects data from external sources such as earthquakes, weather, traffic, and evacuation shelters. For this purpose, it uses APIs from the Japan Meteorological Agency.

[1032] 2. Data analysis method: Analyze the acquired data to predict the extent of the disaster impact and damage, and evaluate the risk level.

[1033] 3. Notification method: Analysis results are notified to the user device in real time.

[1034] 4. Emotional data analysis means: Analyzes the user's emotional data and generates individual evacuation instructions and support information based on their emotional state.

[1035] Terminal handling

[1036] The user device (e.g., a smartphone) comprises the following means:

[1037] 1. Notification receiving means: Receives notifications from the server and notifies the user via push notifications or voice alerts.

[1038] 2. Information display method: Received evacuation information and action advice are displayed in an easy-to-understand manner to the user.

[1039] 3. Emotional state monitoring: Monitor the user's emotional state in real time and provide advice to calm the emotions as needed.

[1040] 4. Emotional state reporting means: The emotional state of the user detected using the emotion engine is sent to the server.

[1041] 5. Feedback transmission means: Sends feedback about the user's evacuation situation and emotions to the server.

[1042] User behavior

[1043] 1. Initial setup: Users register their personal information during normal times and store it on their devices. This allows them to receive prompt and appropriate assistance in the event of a disaster.

[1044] 2. Emergency response: Users can quickly take evacuation action according to notifications on their devices and calm down by following the advice on their devices.

[1045] 3. Reporting evacuation completion: Once the user has completed the evacuation, they can report it by pressing the evacuation completion button on their device.

[1046] Hardware and Software Used

[1047] Server: Web server using Flask

[1048] Device: iOS or Android device

[1049] Data collection source: Japan Meteorological Agency API, etc.

[1050] Specific examples

[1051] Scenario: Evacuation support immediately after an earthquake occurs at a brick-and-mortar store

[1052] 1. The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the store area.

[1053] 2. The app receives risk information and evacuation instructions from the server and sends push notifications to customers in the store.

[1054] 3. The customer checks the notice and evacuates by following the instructed safe evacuation route.

[1055] 4. The app monitors the customer's emotional state and displays relaxation suggestions if they are feeling anxious.

[1056] Prompt Sentence Examples

[1057] "Get earthquake information from the Japan Meteorological Agency and analyze the risk level. Create a Python Flask application that provides optimal evacuation advice to users based on the results."

[1058] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1059] Step 1: Data collection

[1060] The server collects data from external sources such as earthquakes, weather, traffic, and evacuation shelters through APIs. The input data is the latest disaster information received from the API, and the output data is unprocessed disaster data stored in the server. In this process, the server periodically calls the API to obtain and store the latest information.

[1061] Step 2: Data analysis

[1062] The server analyzes the collected data to assess the scope of the disaster impact and the risk level. The input data is the raw disaster data collected in step 1, and the output data is the analyzed risk assessment results. In this process, the server evaluates the data using an analysis algorithm and determines the risk level.

[1063] Step 3: Generate notifications

[1064] The server generates appropriate evacuation instructions based on the analysis results and notifies the user device. The input data is the risk assessment result obtained in step 2, and the output data is the evacuation instructions to be sent to the user device. In this process, the server generates appropriate evacuation advice and prepares it for notification to the user device.

[1065] Step 4: Receive notifications

[1066] The device receives notifications sent from the server and notifies the user via push notifications or voice alerts. The input data is the evacuation instructions sent from the server, and the output data is the push notification or voice alert received by the user. In this process, the device receives the notification via a communication protocol and displays it to the user.

[1067] Step 5: Display information

[1068] The device receives evacuation information and action advice and displays it in an easy-to-understand manner to the user. The input data is evacuation instructions from the server, and the output data is evacuation routes and instructions that the user can visually confirm on the device. In this process, the device displays evacuation information on the screen, and the user confirms the information.

[1069] Step 6: Emotional State Monitoring

[1070] The device monitors the user's emotional state in real time and provides advice to calm the user as needed. The input data is real-time data on the user's facial expressions and behavior, and the output data is suggested relaxation methods. In this process, the device uses cameras and sensors to detect the user's emotions and displays appropriate advice.

[1071] Step 7: Emotional State Report

[1072] The device transmits the user's emotional state detected using the emotion engine to the server. The input data is the user's emotional data obtained in step 6, and the output data is the emotional state information to be transmitted to the server. In this process, the device transfers the emotional data to the server via a communication protocol.

[1073] Step 8: Send your feedback

[1074] The device sends user feedback to the server. The input data is the evacuation completion report and emotional feedback from the user, and the output data is the feedback information to be sent to the server. In this process, the user inputs feedback through the device interface, and the device sends it to the server.

[1075] Through these steps, a system will be realized that allows users to take prompt and appropriate evacuation actions in the event of a disaster and receive support according to their emotions.

[1076] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1077] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1078] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1079] [Third embodiment]

[1080] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1081] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1082] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1083] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1084] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1085] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1086] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1087] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1088] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1089] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1090] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1091] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1092] This paper describes a system that collects data, analyzes it, and notifies the results to user devices in real time. The system is intended to support evacuation in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[1093] Server Processing

[1094] 1. Data Collection

[1095] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[1096] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[1097] 2. Data Analysis

[1098] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[1099] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[1100] 3. Individual support information generation

[1101] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[1102] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[1103] 4. Notification sending

[1104] The server notifies the user device of analysis results and evacuation instructions in real time.

[1105] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[1106] Terminal handling

[1107] 1. Receiving notifications

[1108] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[1109] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[1110] 2. Information display

[1111] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[1112] - Example: The device displays the safest evacuation route on a map.

[1113] 3. Two-way communication

[1114] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[1115] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[1116] User behavior

[1117] 1. Initial Setup

[1118] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[1119] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[1120] 2. Emergency Response

[1121] Users can quickly take evacuation action by following the notifications on their devices.

[1122] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[1123] 3. Reporting completion of evacuation

[1124] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[1125] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[1126] Specific examples

[1127] 1. Scenario: Evacuation immediately after an earthquake occurs

[1128] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[1129] - The device receives evacuation warnings from the server and notifies the user via push notification.

[1130] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[1131] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[1132] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" helps users take swift and appropriate evacuation actions. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operations are described in detail in the processing steps below.

[1133] The processing flow will be explained below.

[1134] Step 1: Initial Setup (Normal)

[1135] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information, etc.).

[1136] Step 2: Upload your information

[1137] The terminal sends the information entered by the user to the server, and the terminal uploads the user data to the server using a secure communication protocol (e.g., HTTPS).

[1138] Step 3: Update the database

[1139] The server stores the received information in a database. The server creates a new user entry in the database and stores the personal information.

[1140] Step 4: Periodic data collection

[1141] The server periodically collects data from various sources, such as the Japan Meteorological Agency API, traffic information API, and evacuation shelter information API.

[1142] Step 5: Analyze and save

[1143] The server analyzes the collected data and stores the necessary information in a database. The server also stores new earthquake risk assessments and evacuation shelter status information.

[1144] Step 6: Update information

[1145] The device periodically retrieves data from the server and stores it in local storage. The device queries the server daily or at a specified frequency and stores the latest information locally.

[1146] Step 7: Obtain emergency information

[1147] The server immediately obtains earthquake occurrence information. The server receives immediate notification when an earthquake occurs via the Japan Meteorological Agency's real-time API.

[1148] Step 8: Real-time analysis

[1149] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity and impact area of ​​the earthquake and identify areas where evacuation warnings are required.

[1150] Step 9: Generate notifications

[1151] The server generates evacuation advisory notices based on the analysis results. The server creates notices for highly affected areas that include specific evacuation instructions and information on safe evacuation routes.

[1152] Step 10: Send emergency notifications

[1153] The server sends an emergency notification to the device. The server uses a push notification service (e.g., Firebase Cloud Messaging) to send the emergency notification to the user's device in real time.

[1154] Step 11: Receiving and viewing notifications

[1155] The device receives the emergency notification from the server and displays it to the user. The device notifies the user of the emergency information using a voice alert or push notification.

[1156] Step 12: Check evacuation instructions

[1157] The user checks the notification on the device and begins the specified evacuation action. The user then checks the evacuation route and location information of the evacuation shelter on the device screen.

[1158] Step 13: Evacuation

[1159] The user follows the evacuation route indicated by the device and moves to a safe location. The user heads to the designated evacuation shelter using the map and route information displayed on the device as a reference.

[1160] Step 14: Evacuation completion report

[1161] When the user has completed evacuation, they press the evacuation completion button on their device. When the user arrives at the evacuation shelter, they tap the evacuation completion button in the app.

[1162] Step 15: Submitting the completed information

[1163] The terminal sends an evacuation completion report to the server. The terminal sends the evacuation completion information to the server along with the user's location data.

[1164] Step 16: Database Update

[1165] The server stores the evacuation completion information in a database and manages the evacuation situation. The server updates the evacuation situation map in real time based on the received evacuation completion data.

[1166] Example 1

[1167] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1168] In modern society, rapid and accurate information provision and evacuation instructions are required when a disaster occurs. However, conventional systems can be slow in collecting and analyzing information, making it difficult for users to take appropriate evacuation actions. Another problem is that support tailored to each user's individual situation is not provided adequately. In particular, it has been technically difficult to provide analysis results and issue individual evacuation instructions in real time. There is a need for a system that can solve these issues.

[1169] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1170] In this invention, the server includes a means for collecting information, a means for analyzing the collected information, and a means for notifying a user terminal of the analysis results in real time. This allows users to receive prompt and accurate information and take appropriate evacuation actions. The server also includes a means for collecting information from various sources in an emergency, a means for predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users, a means for registering personal information of users in normal times, a means for generating individual evacuation instructions and support information in the event of a disaster, and a means for reporting the user's status to the server, thereby providing support tailored to each user's individual situation. Furthermore, the user terminal includes a means for receiving emergency notifications from the server and presenting them to the user, a means for transmitting user feedback to the server, and a means for periodically updating the user terminal with the latest evacuation information. This allows users to always receive the latest and most reliable information and encourage appropriate evacuation actions.

[1171] - "Means of collecting information" refers to the system for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[1172] "Means for analyzing collected information" refers to algorithms and software that use the acquired data to predict the extent of the disaster's impact and damage.

[1173] "Means for notifying the user terminal of the analysis results in real time" refers to a communication means for instantly transmitting the analyzed data to the user's device.

[1174] "A means of predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users" is a system for assessing the impact of a disaster when it occurs and instructing users on the most appropriate course of action.

[1175] "Means for registering users' personal information in peacetime" refers to a system for registering personal information such as users' addresses and emergency contact details before a disaster occurs.

[1176] "Means for generating individual evacuation instructions and support information in the event of a disaster" refers to a system that provides information on appropriate evacuation routes and evacuation locations in the event of a disaster, based on information registered in advance by the user.

[1177] "Means for reporting the user's status to the server" refers to a communication means for transmitting the user's current location and evacuation status to the server, and for the server to grasp this information.

[1178] "Means for the user terminal to receive emergency notifications from the server and present them to the user" refers to a mechanism by which the user's device receives emergency information sent from the server and provides feedback to the user.

[1179] "Means for sending user feedback to the server" refers to a mechanism for sending information and status reports provided by users to the server.

[1180] "Means for regularly updating the latest evacuation information to user devices" refers to a system that regularly delivers the latest evacuation information to users' devices and keeps the information up to date.

[1181] This invention relates to a system that provides evacuation instructions and support information quickly and accurately in the event of an emergency such as a natural disaster. This system is composed of three main elements: a server, terminals, and users, each of which fulfills a specific role to function as a whole.

[1182] Server embodiment

[1183] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources. This data is collected using Python scripts that retrieve information from external data providers such as the Japan Meteorological Agency's API. The data obtained is in JSON format and stored in the server's database.

[1184] The server then analyzes the collected data in real time. It uses Python libraries such as Pandas and NumPy to create data frames, and uses statistical processing and machine learning models to predict the extent of the disaster's impact and damage. The analysis results are then used to generate appropriate evacuation instructions for users.

[1185] Furthermore, the server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times. Specifically, it uses the Geopandas library to identify the nearest evacuation shelter and safe evacuation route from the user's address information using GIS data.

[1186] Finally, the server notifies the user device in real time of the analysis results and evacuation instructions using Firebase Cloud Messaging (FCM), and the server calls the FCM API to send push notifications.

[1187] Terminal embodiment

[1188] The device receives notifications from the server and notifies the user via push notifications or voice alerts. For example, on Android devices, notifications are received using Firebase's notification manager. If an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency alert.

[1189] The device also displays the received evacuation and support information in an easy-to-understand manner to the user. By using the Google Maps API, evacuation routes are visually displayed on a map, allowing users to easily check their evacuation routes.

[1190] The device also sends user feedback to the server, allowing the server to understand the user's current location and evacuation status in real time and provide additional assistance information as needed.When the user presses the evacuation completion button, the device sends an HTTP request to the server, updating the status in the database.

[1191] User's embodiment

[1192] Users register their personal information with the application during normal times, including their name, address, emergency contact information, etc. This information is stored on the device and securely transferred to the server when necessary.

[1193] When an emergency occurs, the user quickly takes evacuation action according to the notification from the device. For example, the user checks the notification on the device and moves to a safe shelter according to the evacuation route displayed. After completing the evacuation, the user presses the evacuation completion button on the device to report to the server.

[1194] Specific examples

[1195] Example prompt:

[1196] "Please tell me the evacuation route immediately after an earthquake occurs. Please suggest the optimal evacuation route based on the information obtained from the server."

[1197] In response to such prompts, the system generates the optimal evacuation route in real time based on the user's current location and information on the nearest evacuation shelter, and notifies the user. The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area, and the device receives evacuation advisories from the server and notifies the user via push notification. The user checks the notification on their device, takes the specified evacuation action, and after arriving at the evacuation shelter, presses the evacuation completion button to report to the server.

[1198] As a result, the system of the present invention can provide prompt and accurate evacuation support in the event of a disaster, thereby minimizing damage.

[1199] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1200] Step 1: Gather information

[1201] Input: Real-time data provided by APIs from external sources (such as the Japan Meteorological Agency and traffic information providers)

[1202] Specific operation: The server periodically executes a Python script and sends requests to the Japan Meteorological Agency's API, which retrieves data in JSON format, such as earthquake, weather, traffic, and evacuation shelter information. The server automatically collects this data and stores it in a database.

[1203] Output: Various disaster-related data stored in the database

[1204] Step 2: Data analysis

[1205] Input: Collected data stored in a database

[1206] Specific operation: The server uses Python's Pandas and NumPy libraries to create a data frame. Based on this, statistical processing and machine learning models are applied to predict the extent of the disaster impact and damage. For example, earthquake data is analyzed to calculate the epicenter, magnitude, and damage forecast.

[1207] Output: Analysis results (e.g., risk of building collapse in a specific area, evacuation advisories)

[1208] Step 3: Generate personalized support information

[1209] Input: User's registered personal information (address, emergency contact, etc.) and analysis results

[1210] Specific operation: The server uses the user's personal information acquired during normal times to identify the best evacuation shelter and safe evacuation route using libraries such as Geopandas. For example, it searches for the nearest evacuation shelter based on the user's address information and generates a route to that shelter.

[1211] Output: Individual evacuation instructions and support information (e.g., evacuation shelter list, evacuation route)

[1212] Step 4: Send notification

[1213] Input: Individual evacuation instructions and support information

[1214] Specific operation: The server uses Firebase Cloud Messaging (FCM) to send notifications to the user's device in real time. It calls the FCM API and sends appropriate evacuation warnings and route information to the user via push notifications.

[1215] Output: Evacuation notification sent to user device

[1216] Step 5: Receive notifications

[1217] Input: Notification sent from the server

[1218] Specific operation: The device receives notifications from the FCM and displays alerts and push notifications to the user. For example, if an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency notification to the user.

[1219] Output: Urgent notification displayed on the user's screen

[1220] Step 6: Display information

[1221] Input: Received evacuation instructions and assistance information

[1222] How it works: The device uses the Google Maps API to visually display evacuation routes, allowing users to identify safe evacuation routes and the location of evacuation shelters.

[1223] Output: Evacuation route and shelter information displayed on the device screen

[1224] Step 7: Two-way communication

[1225] Input: User feedback (e.g., information on pressing the evacuation complete button)

[1226] Specific operation: When a user arrives at a shelter and presses the "Evacuation Complete" button on their device, that information is sent to the server as an HTTP request. The server receives this information and updates the database.

[1227] Output: Evacuation completion information sent to the server

[1228] Step 8: Initial Setup

[1229] Input: User's personal information (name, address, emergency contact, etc.)

[1230] Specific operation: The user enters the necessary information on the app's settings screen, which is saved on the device. The data is then transferred to the server via secure communication and registered in the database.

[1231] Output: Personal information of registered users

[1232] Step 9: Emergency response

[1233] Input: Evacuation information received from the server

[1234] Specific actions: The user checks the notification on the device and takes prompt action to evacuate by following the displayed evacuation route. Specifically, the user follows the evacuation route on the map and moves to a safe evacuation shelter.

[1235] Output: User's evacuation behavior

[1236] Step 10: Evacuation completion report

[1237] Input: User's evacuation completion operation (pressing the evacuation completion button)

[1238] Specific operation: When the user arrives at the evacuation shelter and presses the evacuation completion button, the device sends the information to the server. The server receives this report and updates the database to record the evacuation completion status.

[1239] Output: Evacuation completion information recorded on the server

[1240] (Application example 1)

[1241] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1242] To enable autonomous vehicles and other mobile devices to evacuate quickly and efficiently in the event of a disaster, a system is needed that can obtain disaster information in real time, provide optimal evacuation routes, and automatically follow those routes. It is also necessary to grasp the user's evacuation status in real time and provide additional assistance. Conventional systems do not integrate these functions, making it difficult for users to evacuate quickly and effectively.

[1243] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1244] In this invention, the server includes a means for collecting data, a means for analyzing the collected data, and a means for notifying the user device of the analysis results in real time. This enables real-time acquisition and analysis of disaster information and provision of optimal evacuation routes during disasters. Furthermore, this invention also includes a means for displaying optimal evacuation routes for mobile objects based on the analysis results, and a means for the mobile object to automatically move along the evacuation route. This enables self-driving vehicles and other mobile objects to evacuate quickly and efficiently.

[1245] "Means of collecting data" refers to systems and methods for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[1246] "Means for analyzing collected data" refers to systems and methods for analyzing acquired data and predicting the extent of the impact and damage of a disaster.

[1247] "Means for notifying a user device of analysis results in real time" refers to a system or method for instantly delivering and notifying a user device of analysis results.

[1248] "Means for displaying the optimal evacuation route for a moving object based on the analysis results" refers to a system or method for presenting the optimal evacuation route for a moving object based on analyzed evacuation information.

[1249] "Means for a mobile body to automatically move along an evacuation route" refers to a system or method in which a mobile body automatically operates along a presented optimal evacuation route.

[1250] "Means for registering users' personal information in peacetime" refers to systems and methods for registering users' personal information in a database before a disaster occurs.

[1251] "Means for providing individual evacuation instructions based on user registration information in an emergency" refers to a system or method that uses user registration information to provide individually customized evacuation instructions in the event of a disaster.

[1252] "Means for reporting the user's evacuation status to the server" refers to a system or method for transmitting and reporting the user's evacuation status to the server.

[1253] "Means for monitoring evacuation situations in real time and providing additional support information" refers to a system or method for monitoring a user's evacuation situation in real time and providing any additional support that is required.

[1254] "Means for regularly updating the latest evacuation information to the user's device" refers to a system or method for regularly updating the latest evacuation information to the user's device.

[1255] "Means for a device to receive an emergency notification from a server and display it to a user" refers to a system or method in which a device receives an emergency message from a server and displays an alert to a user.

[1256] "Means for transmitting user feedback to a server" refers to a system or method for transmitting user-provided information or feedback to a server.

[1257] "Means for notifying the server of the evacuation completion status of a mobile body in an emergency" refers to a system or method for reporting to the server that the evacuation of a mobile body has been completed in an emergency.

[1258] This invention is a system that supports autonomous vehicles and other mobile objects to evacuate quickly and efficiently in the event of a disaster. Here, we will explain the roles of the server, terminal, and user, as well as the specific implementation method of the entire system.

[1259] Server Processing

[1260] 1. Data Collection

[1261] The server periodically obtains data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources using APIs. This process is achieved using a programming language such as Python and a library for making HTTP requests (e.g., requests).

[1262] 2. Data Analysis

[1263] The collected data is analyzed in real time to predict the extent of the disaster impact and damage. This is done using machine learning models and data analysis libraries (e.g., scikit-learn). Based on the analysis results, the optimal evacuation route is calculated.

[1264] 3. Sending notifications

[1265] The analysis results are sent to the user's device in real time using a push notification service (e.g., Firebase Cloud Messaging).

[1266] Terminal handling

[1267] 1. Receiving notifications

[1268] The terminal receives notifications from the server and notifies the user via push notifications or audio alerts. This role is played by user devices such as smartphones or head-mounted displays (HUDs).

[1269] 2. Information display

[1270] The device will then display the received evacuation information in an easy-to-understand manner. In particular, the HUD of the autonomous vehicle will display evacuation routes. This will be done using a map display library (e.g., Google Maps API).

[1271] 3. Two-way communication

[1272] The device sends user feedback to a server and monitors the evacuation situation in real time, allowing it to provide additional assistance if needed.

[1273] User Behavior

[1274] 1. Initial Setup

[1275] Users register their personal information in normal times using a smartphone app or web interface.

[1276] 2. Emergency Response

[1277] Users receive notifications from their devices and follow instructions to quickly take evacuation action. In the case of autonomous vehicles, the vehicles will automatically begin moving along the evacuation route provided.

[1278] 3. Reporting completion of evacuation

[1279] When the user arrives at the evacuation shelter, they press the evacuation completion button on their device to report to the server. This information is used to appropriately plan the next evacuation measures.

[1280] Specific examples

[1281] For example, if an earthquake occurs while a user is in an autonomous vehicle, the system immediately obtains the latest disaster information and calculates and displays the optimal evacuation route. The autonomous vehicle then automatically begins driving and continues to a safe evacuation shelter. After arriving at the evacuation shelter, the user can use their device to report the completion of evacuation to the server, and the server can use that information to provide additional assistance.

[1282] Prompt Sentence Examples

[1283] "Design an application that provides detailed earthquake information, calculates and displays the route from your current location to the best evacuation shelter, and includes a function that allows an autonomous vehicle to automatically evacuate by following that route."

[1284] The above is a specific embodiment of the disaster evacuation support system of the present invention, which enables users to evacuate quickly and efficiently based on real-time disaster information.

[1285] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1286] Processing steps and specific operations

[1287] Step 1:

[1288] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources via API. Specifically, it sends HTTP requests to API endpoints such as those of the Japan Meteorological Agency and traffic information providers, and obtains the returned JSON data. This collected data becomes the input for processing and is stored internally on the server.

[1289] Step 2:

[1290] The server analyzes the collected data in real time, using machine learning generative AI models and data analysis libraries (e.g., scikit-learn). The purpose of the analysis is to predict the extent of the disaster's impact and damage, using collected weather and earthquake information as input data, and then outputting specific analysis results such as evacuation routes.

[1291] Step 3:

[1292] The server then sends real-time evacuation information to the user device based on the analysis results. This notification is sent using a push notification service (e.g., Firebase Cloud Messaging). Specifically, the server formats the analysis results and sends a push notification specifying the user device's identifier. During this process, the notification content is generated as output data.

[1293] Step 4:

[1294] The device receives the notification sent from the server and notifies the user. Specifically, a smartphone or head-mounted display (HUD) receives a push notification and displays it to the user as an audio alert or a pop-up on the screen. This notification becomes input data and is output in the form of an alert display.

[1295] Step 5:

[1296] The device displays the optimal evacuation route to the user. A map display library (e.g., Google Maps API) is used to display the evacuation route. After receiving the push notification, the device obtains the evacuation route information as an analysis result and displays it on the device screen or HUD. The input of this process is the notification from the server, and the output is a visual representation of the evacuation route.

[1297] Step 6:

[1298] The autonomous vehicle automatically begins moving according to the displayed evacuation route. The vehicle's autonomous driving system manages this process and generates the control signals necessary to operate according to the evacuation route. The input is the evacuation route information, and the output is the movement of the vehicle.

[1299] Step 7:

[1300] The device reports the user's evacuation completion status to the server. Specifically, when the user arrives at the evacuation shelter and presses the evacuation completion button on the device, a message indicating evacuation completion is sent to the server. The input is the user's operation, and the output is the report data.

[1301] Step 8:

[1302] The server receives the evacuation completion report and provides additional support information as needed. This support information is generated using a generative AI model based on the latest situation and notified to the user device. The input is the evacuation completion report data, and the output is the support information.

[1303] Through the above processing steps, the disaster evacuation support system of the present invention supports mobile bodies, including autonomous vehicles, in taking evacuation actions quickly and efficiently.

[1304] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1305] This invention combines a system that collects data, analyzes it, and notifies the user device of the results in real time with an emotion engine that recognizes the user's emotions and provides evacuation instructions and support information based on those emotions. The aim is to help users receive appropriate information and take swift and calm evacuation action, particularly in the event of a disaster. The system consists of three main elements: a server, a terminal, and a user, to which the emotion engine is added.

[1306] Server Processing

[1307] 1. Data Collection

[1308] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[1309] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[1310] 2. Data Analysis

[1311] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[1312] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[1313] 3. Individual support information generation

[1314] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[1315] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[1316] 4. Notification sending

[1317] The server notifies the user device of analysis results and evacuation instructions in real time.

[1318] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[1319] 5. Emotional Data Analysis

[1320] The server analyzes the data from the emotion engine and generates additional support information and advice based on the user's emotional state.

[1321] - Example: The server provides advice on how to relax if the user is feeling stressed.

[1322] Terminal handling

[1323] 1. Receiving notifications

[1324] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[1325] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[1326] 2. Information display

[1327] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[1328] - Example: The device displays the safest evacuation route on a map.

[1329] 3. Emotional state monitoring

[1330] The device monitors the user's emotional state in real time and provides advice and messages to calm the emotions as needed.

[1331] - Example: The device can recognize the user's facial expressions and suggest relaxation techniques if they are feeling anxious.

[1332] 4. Emotional State Report

[1333] The device uses an emotion engine to detect the user's emotional state and transmits it to the server.

[1334] - Example: The device sends information about the user's stress to the server.

[1335] 5. Two-way communication

[1336] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[1337] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[1338] User behavior

[1339] 1. Initial Setup

[1340] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[1341] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[1342] 2. Emergency Response

[1343] Users can quickly take evacuation action by following notifications on their device, and calm down by following advice on the device.

[1344] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[1345] 3. Reporting completion of evacuation

[1346] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[1347] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[1348] Specific examples

[1349] 1. Scenario: Evacuation immediately after an earthquake occurs

[1350] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[1351] - The device receives evacuation warnings from the server and notifies the user via push notification.

[1352] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[1353] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[1354] - The device monitors the user's emotional state and provides relaxation advice if they are feeling stressed.

[1355] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" supports swift and appropriate evacuation actions while taking into account the user's emotional state. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operation are described in detail in the processing steps below.

[1356] The processing flow will be explained below.

[1357] Step 1: User Registration

[1358] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information).

[1359] Step 2: Send information

[1360] The device sends the information entered by the user to the server. The device transmits the data securely using HTTPS.

[1361] Step 3: Update the database

[1362] The server stores the received user information in a database. The server creates a new user entry and stores the personal information securely.

[1363] Step 4: Data collection during normal times

[1364] The server periodically collects earthquake information, weather information, traffic information, evacuation shelter information, etc. from related organizations. The server obtains the latest information using API.

[1365] Step 5: Data analysis during normal times

[1366] The server analyzes the collected data and stores the necessary information in a database. The server updates the database with new risk assessments and shelter status information.

[1367] Step 6: Update information

[1368] The device retrieves data from the server and stores it in local storage. The device queries the server at a specified frequency and downloads the latest information.

[1369] Step 7: Obtain emergency information

[1370] The server obtains earthquake occurrence information in real time. The server receives earthquake information via the Japan Meteorological Agency's real-time API.

[1371] Step 8: Real-time data analysis

[1372] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity and impact area, and identifies areas where evacuation orders are required.

[1373] Step 9: Generate notifications

[1374] The server generates evacuation advisory notices based on the analysis results. The server creates notices that include specific evacuation instructions and evacuation routes.

[1375] Step 10: Send emergency notifications

[1376] The server sends emergency notifications to the device. The server uses a push notification service to send emergency notifications in real time.

[1377] Step 11: Receiving and viewing notifications

[1378] The device receives the emergency notification and notifies the user. The device notifies the user of the emergency information via voice alerts or push notifications.

[1379] Step 12: Check evacuation instructions

[1380] The user confirms the notification and begins the specified evacuation action. The user checks the evacuation route and evacuation shelter information on the device screen.

[1381] Step 13: Emotional State Monitoring

[1382] The device monitors the user's emotional state in real time and evaluates the user's emotions using facial expression recognition and voice analysis.

[1383] Step 14: Sending Emotion Data

[1384] The device sends the data obtained from the emotion engine to the server, and the device periodically reports the user's stress level and emotional state.

[1385] Step 15: Sentiment Data Analysis

[1386] The server analyzes the emotional data and generates support information based on the emotional state. If stress levels are high, the server generates relaxation advice.

[1387] Step 16: Evacuation

[1388] The user follows the evacuation route indicated by the device to a safe location. The user follows the map and route information displayed on the device.

[1389] Step 17: Providing emotional support information

[1390] The device receives the emotional support information from the server and displays it to the user. The device displays a message for stress reduction.

[1391] Step 18: Evacuation completion report

[1392] When the user has completed the evacuation, they press the evacuation completion button on their device. After arriving at the evacuation shelter, the user reports that the evacuation has been completed.

[1393] Step 19: Submit completion information

[1394] The terminal sends a report of completion of evacuation to the server. The terminal also sends information about arrival at the evacuation shelter to the server.

[1395] Step 20: Update the database

[1396] The server stores the evacuation completion information in a database and manages the evacuation situation. The server updates the evacuation situation map in real time.

[1397] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" utilizes an emotion engine to support quick and appropriate evacuation actions while taking into account the user's emotional state, enabling safe and effective evacuation even in a chaotic information environment.

[1398] Example 2

[1399] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1400] Conventional disaster response systems focus on collecting, analyzing, and notifying users of disaster information, but lack the ability to provide evacuation instructions and support information that takes into account the user's emotional state. This makes it difficult for users who are stressed or anxious to take appropriate evacuation actions. Furthermore, they are also inadequate in properly monitoring the user's emotional state in an emergency and providing support based on that state. Therefore, the present invention is required to analyze the user's emotional state in real time and provide appropriate support.

[1401] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for collecting data, a means for analyzing the collected data, a means for notifying the user device of the analysis results in real time, a means for analyzing the emotional state of the user, a means for generating support information based on the emotional state, and a means for notifying the user device of the support information. This enables the user to receive appropriate evacuation instructions and support in real time, taking into account the emotional state, even in the event of a disaster.

[1402] 1. "Means of collecting data" refers to the function for obtaining data on disasters in real time from various sources.

[1403] 2. "Means for analyzing collected data" refers to a function that processes acquired data in real time and predicts the extent of the impact of a disaster and damage.

[1404] 3. "Means for notifying the user device of analysis results in real time" refers to a function for quickly sending and notifying the user device of analysis results.

[1405] 4. "Means for analyzing the user's emotional state" refers to a function for understanding the user's current emotional state by collecting and analyzing emotional data.

[1406] 5. "Means for generating support information based on emotional state" is a function for creating support information and advice appropriate for the user based on the analyzed emotional state.

[1407] 6. "Means for notifying user devices of assistance information" refers to a function for notifying user devices of generated assistance information in real time.

[1408] 7. "Means for registering user personal information during normal times" refers to a function for registering a user's personal information and location in the system when no disaster has occurred.

[1409] 8. "Means for providing individual evacuation instructions based on the user's registered information in an emergency" refers to a function for providing appropriate evacuation instructions to the user in an emergency based on personal information registered in advance.

[1410] 9. "Means for reporting the user's evacuation status to the server" is a function that allows the user to communicate the evacuation status to the server.

[1411] 10. "Means for monitoring the user's emotional state" means a function that monitors the user's emotional state in real time and collects data as necessary.

[1412] 11. "Means for providing emotional support information based on monitoring results" refers to a function for providing support information appropriate to the user in real time based on collected emotional data.

[1413] 12. "Means for periodically updating the latest evacuation information on the user's device" refers to a function for periodically sending and updating the latest evacuation information on the user's device.

[1414] 13. "Means for a terminal to receive an emergency notification from a server and display it to the user" refers to a function that allows a user's terminal to receive an emergency notification sent from a server and display it to the user.

[1415] 14. "Means for sending user feedback to the server" refers to a function for sending information and opinions entered by users to the server.

[1416] 15. "Means for reporting the user's emotional state to the server" means a function for transmitting and reporting data on the user's emotional state to the server.

[1417] This invention combines a system that collects disaster information, analyzes it, and notifies the user device of the results in real time with an emotion engine that recognizes the user's emotions and provides evacuation instructions and support information based on those emotions. The system consists of three main elements: a server, a terminal, and a user, to which an emotion engine is added.

[1418] Server configuration and processing

[1419] The server has the following main functions:

[1420] 1. Data Collection

[1421] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources using APIs.

[1422] Specifically, we use the Japan Meteorological Agency's API and traffic information API. For example, run curl -s http: / / api.weather.go.jp / earthquake to obtain earthquake data.

[1423] 2. Data Analysis

[1424] Using libraries such as Python, the collected data is analyzed in real time, and algorithms are run to estimate damage and the extent of impact in specific areas.

[1425] Example: Using pandas and numpy to process earthquake data and assess the risk of building collapse.

[1426] 3. Individual support information generation

[1427] Individual evacuation instructions and support information are generated based on the personal information and location information of users that have been registered in advance.

[1428] For example, an SQL query can be used to retrieve a user's address information and list information about evacuation shelters in that area.

[1429] 4. Notification sending

[1430] Using Firebase Cloud Messaging (FCM), analysis results and evacuation instructions are sent to user devices in real time.

[1431] Example: Using the FCM API to send an urgent notification via a POST request.

[1432] 5. Emotional Data Analysis

[1433] The data provided by the emotion engine is analyzed to generate additional support information and advice based on the user's emotional state.

[1434] Example: Using an NLP library (e.g., spaCy) to analyze emotion data and generate relaxation advice.

[1435] Terminal configuration and handling

[1436] The terminal has the following main functions:

[1437] 1. Receiving notifications

[1438] Receives emergency notifications sent from the server and notifies the user via push notifications or voice alerts.

[1439] Example: Display a notification using the onMessageReceived method in an Android app.

[1440] 2. Information display

[1441] The received action advice and evacuation information are visually displayed to the user. Evacuation routes and shelters are displayed using a map API.

[1442] Example: Displaying evacuation routes on a map using the Google Maps API.

[1443] 3. Emotional state monitoring

[1444] It uses the device's camera to recognize the user's facial expressions in real time and sends that data to the emotion engine.

[1445] Example: Facial expression recognition using OpenCV and dlib libraries.

[1446] 4. Emotional State Report

[1447] The user's emotional state is periodically transmitted to the server.

[1448] Example: Send emotion data to the server using an HTTP POST request.

[1449] 5. Two-way communication

[1450] User feedback and evacuation status are reported to the server.

[1451] Example: When a user presses the "Evacuation Complete" button, that information is sent to the server via a POST request.

[1452] User Behavior

[1453] The user uses the system as follows:

[1454] 1. Initial Setup

[1455] Register your personal information and emergency contact information in the app during normal times.

[1456] Example: Enter your address and contact information on the settings screen and press the save button.

[1457] 2. Emergency Response

[1458] Follow the notifications on your device to quickly take evacuation action. Move along the evacuation route provided by your device.

[1459] For example: Tap on a notification on your phone to see more information and follow the instructions to a safe haven.

[1460] 3. Reporting completion of evacuation

[1461] Once the evacuation is complete, press the "Evacuation Complete" button on the device to report to the server.

[1462] Example: After arriving at a shelter, press the "Evacuation Complete" button in the app to send the information.

[1463] As a result, the system of the present invention can support quick and appropriate evacuation actions while taking into account the user's emotional state, and provide an environment in which users can act with peace of mind even in the event of a disaster.

[1464] Prompt Sentence Examples

[1465] An example of information that a user might enter into a terminal is the prompt:

[1466] "If an emergency earthquake alert is received, please tell me the nearest evacuation shelter."

[1467] "I'm feeling stressed. I'd like some advice on how to relax."

[1468] "The evacuation route is congested. Please tell me an alternative route."

[1469] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1470] Step 1: Data collection

[1471] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources using APIs.

[1472] Input: Data obtained from an API endpoint (e.g., the Japan Meteorological Agency's earthquake information API)

[1473] Data processing: Parse the JSON format data obtained from the API and extract the necessary information.

[1474] Output: Formatted data objects for earthquakes, weather, traffic, evacuation shelters, etc.

[1475] Specific operation: Use an HTTP client such as curl to periodically retrieve data, and then use a Python script to parse and save the JSON data.

[1476] Step 2: Data analysis

[1477] The server analyzes the collected data in real time and predicts the extent of the disaster's impact and damage.

[1478] Input: Formatted data objects (earthquake, weather, traffic, evacuation shelter data)

[1479] Data calculation: Based on the acquired data, a damage prediction algorithm is run to calculate the extent of impact and risk level.

[1480] Output: Damage prediction data object (e.g., collapse risk assessment by region)

[1481] Specific operation: Using Python libraries (pandas and numpy), damage prediction models are executed and risk assessments are performed.

[1482] Step 3: Generate individual support information

[1483] The server generates individual evacuation instructions and support information based on the user's personal information and location information.

[1484] Input: Damage prediction data object, user's personal information and location information

[1485] Data processing: Identify target areas based on user information and generate evacuation instructions for those areas.

[1486] Output: Evacuation instruction message for each user

[1487] Specific operation: An SQL query is used to extract the user's address information, and the shelter information corresponding to that address is retrieved from the database to generate a message.

[1488] Step 4: Send notification

[1489] The server notifies the user device of the generated analysis results and evacuation instructions in real time.

[1490] Input: User-specific evacuation instruction message

[1491] Data Calculation: Converts the message into notification format and prepares it for transmission.

[1492] Output: Push notification to user device

[1493] Specific operation: The analysis results are sent as a push notification using the Firebase Cloud Messaging (FCM) API.

[1494] Step 5: Receive notifications

[1495] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[1496] Input: Push notification received from FCM

[1497] Data processing: Analyzes received notifications and triggers visual and audio alerts.

[1498] Output: A notification message that is displayed to the user.

[1499] What it does: An Android app overrides the onMessageReceived method to display notifications and, if the notification is important, trigger an audio alert.

[1500] Step 6: Display information

[1501] The terminal displays the received information to the user in an easy-to-understand format.

[1502] Input: Parsed notification message

[1503] Data processing: Formatting the data required to display the information visually.

[1504] Output: Map display of evacuation routes and shelters

[1505] Specific operation: Uses the Google Maps API to display evacuation routes and shelter locations on a map.

[1506] Step 7: Emotional State Monitoring

[1507] The device monitors the user's emotional state in real time.

[1508] Input: User facial expression data obtained from the device's camera

[1509] Data calculation: Analyze facial expression data and determine emotional state.

[1510] Output: User's emotional state data

[1511] Specific operation: Using OpenCV and dlib libraries, facial expression analysis is performed to determine the user's emotional state.

[1512] Step 8: Emotional State Report

[1513] The terminal transmits the user's emotional state to the server.

[1514] Input: Parsed emotional state data

[1515] Data processing: Emotion data is formatted to be sent to the server.

[1516] Output: Emotional state data sent to the server

[1517] Specific operation: Emotion data is sent to the server using an HTTP POST request.

[1518] Step 9: Two-way communication

[1519] The terminal transmits the feedback from the user to the server.

[1520] Input: User-entered feedback information

[1521] Data processing: The feedback information is formatted to be sent to the server.

[1522] Output: Feedback information sent to the server

[1523] What it does: When you press a button in the app, feedback information is sent to the server using an HTTP POST request.

[1524] Step 10: Emergency response

[1525] Users can quickly take evacuation action by following the notifications on their devices.

[1526] Input: Emergency notification received from the device

[1527] Action: Follow the instructions on the device and quickly move to a shelter.

[1528] Output: Move to safe shelter

[1529] Specific actions: Check the evacuation route displayed on the device screen and follow the instructions to move to the evacuation shelter.

[1530] Step 11: Report evacuation completion

[1531] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[1532] Input: User action upon arrival at the evacuation shelter (pressing the evacuation completion button)

[1533] Action: Press the evacuation complete button to report to the server.

[1534] Output: Evacuation completion is reported to the server

[1535] Specific operation: After arriving at the evacuation shelter, press the "Evacuation Complete" button in the app to send the information to the server.

[1536] Through these processing steps, the system of the present invention can support quick and appropriate evacuation actions while taking into account the user's emotional state, and provide an environment in which users can act with peace of mind even in the event of a disaster.

[1537] (Application example 2)

[1538] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1539] In modern society, when a natural disaster occurs, users, especially those staying in physical stores, are required to take prompt and appropriate evacuation actions. However, many users panic during a disaster and find themselves in situations where it is difficult to make calm decisions. In addition, existing disaster information systems only provide general notifications and lack individualized support tailored to each user's situation and emotional state. Therefore, a comprehensive support system is needed to enable users to evacuate efficiently and take appropriate actions.

[1540] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting data, means for analyzing the collected data, means for notifying the user device of the analysis results in real time, means for the user device to notify the user of evacuation routes and evacuation instructions in real time in the event of a disaster, and means for the user device to monitor the user's emotional state and provide advice to support evacuation behavior. This not only enables the user to take prompt and appropriate evacuation behavior in the event of a disaster, but also allows the user's emotional state to be monitored in real time and receive appropriate advice as needed.

[1541] "Means of collecting data" refers to systems or equipment for obtaining information from outside on earthquakes, weather, traffic, evacuation shelters, etc.

[1542] "Means for analyzing collected data" refers to software and algorithms that examine the acquired data and predict the extent of the disaster's impact and damage.

[1543] "Means for notifying the user device of analysis results in real time" refers to communication technologies and protocols for quickly transmitting analyzed information to the user's device.

[1544] "A means for user devices to notify users of evacuation routes and evacuation instructions in real time during a disaster" refers to an application that allows users' smartphones and other devices to display the optimal evacuation routes and evacuation instructions in an emergency.

[1545] "Means for user devices to monitor the user's emotional state and provide advice to assist with evacuation behavior" refers to a function in which the device detects the user's facial expressions and behavior and displays advice such as relaxation methods depending on the situation.

[1546] "Means for registering users' personal information in normal times" refers to an interface that allows users to register personal information such as addresses and contact details when no disaster is occurring.

[1547] "Means for providing individual evacuation instructions based on the user's registered information in an emergency" refers to a system that generates and provides appropriate evacuation instructions based on the user's personal information in the event of a disaster.

[1548] "Means for reporting the user's evacuation status to the server" refers to a communication function for informing the server that the user has completed evacuation actions.

[1549] "Means for the server to assess risk levels and generate evacuation instructions in the event of a disaster" refers to the function for the server to analyze collected data, assess disaster risks, and generate appropriate evacuation instructions.

[1550] "Means for analyzing a user's emotional data and generating support information based on their emotional state" refers to algorithms and software that analyze a user's emotional data and generate support information such as stress relief.

[1551] "Means for regularly updating the latest evacuation information" refers to a function that regularly obtains the latest evacuation-related data and reflects it on the user's device.

[1552] "Means for a device to receive emergency notifications from a server and display them to the user" refers to technology that allows a device to receive alerts and information sent from a server and notify the user visually and audibly.

[1553] "Means for transmitting user feedback to the server" refers to a communication function for transmitting information provided by the user regarding the evacuation situation and emotional state to the server.

[1554] "Means for monitoring the user's emotional state and reporting it to the server" refers to technology that enables the device to detect the user's emotions in real time and communicate that state to the server.

[1555] "Means for a user device to suggest relaxation methods to a user" refers to a function that allows a user device to suggest advice or methods for relaxing based on the user's stress level or emotional state.

[1556] This invention relates to an evacuation support system that supports users in taking prompt and appropriate evacuation actions in the event of a disaster at a physical store. In particular, it focuses on the function of monitoring the user's emotional state in real time and providing support information based on the user's emotions. The specific system configuration and operation are described below.

[1557] Server Processing

[1558] The server has a configuration including the following means:

[1559] 1. Data collection method: The server periodically collects data from external sources such as earthquakes, weather, traffic, and evacuation shelters. For this purpose, it uses APIs from the Japan Meteorological Agency.

[1560] 2. Data analysis method: Analyze the acquired data to predict the extent of the disaster impact and damage, and evaluate the risk level.

[1561] 3. Notification method: Analysis results are notified to the user device in real time.

[1562] 4. Emotional data analysis means: Analyzes the user's emotional data and generates individual evacuation instructions and support information based on their emotional state.

[1563] Terminal handling

[1564] The user device (e.g., a smartphone) comprises the following means:

[1565] 1. Notification receiving means: Receives notifications from the server and notifies the user via push notifications or voice alerts.

[1566] 2. Information display method: Received evacuation information and action advice are displayed in an easy-to-understand manner to the user.

[1567] 3. Emotional state monitoring: Monitor the user's emotional state in real time and provide advice to calm the emotions as needed.

[1568] 4. Emotional state reporting means: The emotional state of the user detected using the emotion engine is sent to the server.

[1569] 5. Feedback transmission means: Sends feedback about the user's evacuation situation and emotions to the server.

[1570] User behavior

[1571] 1. Initial setup: Users register their personal information during normal times and store it on their devices. This allows them to receive prompt and appropriate assistance in the event of a disaster.

[1572] 2. Emergency response: Users can quickly take evacuation action according to notifications on their devices and calm down by following the advice on their devices.

[1573] 3. Reporting evacuation completion: Once the user has completed the evacuation, they can report it by pressing the evacuation completion button on their device.

[1574] Hardware and Software Used

[1575] Server: Web server using Flask

[1576] Device: iOS or Android device

[1577] Data collection source: Japan Meteorological Agency API, etc.

[1578] Specific examples

[1579] Scenario: Evacuation support immediately after an earthquake occurs at a brick-and-mortar store

[1580] 1. The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the store area.

[1581] 2. The app receives risk information and evacuation instructions from the server and sends push notifications to customers in the store.

[1582] 3. The customer checks the notice and evacuates by following the instructed safe evacuation route.

[1583] 4. The app monitors the customer's emotional state and displays relaxation suggestions if they are feeling anxious.

[1584] Prompt Sentence Examples

[1585] "Get earthquake information from the Japan Meteorological Agency and analyze the risk level. Create a Python Flask application that provides optimal evacuation advice to users based on the results."

[1586] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1587] Step 1: Data collection

[1588] The server collects data from external sources such as earthquakes, weather, traffic, and evacuation shelters through APIs. The input data is the latest disaster information received from the API, and the output data is unprocessed disaster data stored in the server. In this process, the server periodically calls the API to obtain and store the latest information.

[1589] Step 2: Data analysis

[1590] The server analyzes the collected data to assess the scope of the disaster impact and the risk level. The input data is the raw disaster data collected in step 1, and the output data is the analyzed risk assessment results. In this process, the server evaluates the data using an analysis algorithm and determines the risk level.

[1591] Step 3: Generate notifications

[1592] The server generates appropriate evacuation instructions based on the analysis results and notifies the user device. The input data is the risk assessment result obtained in step 2, and the output data is the evacuation instructions to be sent to the user device. In this process, the server generates appropriate evacuation advice and prepares it for notification to the user device.

[1593] Step 4: Receive notifications

[1594] The device receives notifications sent from the server and notifies the user via push notifications or voice alerts. The input data is the evacuation instructions sent from the server, and the output data is the push notification or voice alert received by the user. In this process, the device receives the notification via a communication protocol and displays it to the user.

[1595] Step 5: Display information

[1596] The device receives evacuation information and action advice and displays it in an easy-to-understand manner to the user. The input data is evacuation instructions from the server, and the output data is evacuation routes and instructions that the user can visually confirm on the device. In this process, the device displays evacuation information on the screen, and the user confirms the information.

[1597] Step 6: Emotional State Monitoring

[1598] The device monitors the user's emotional state in real time and provides advice to calm the user as needed. The input data is real-time data on the user's facial expressions and behavior, and the output data is suggested relaxation methods. In this process, the device uses cameras and sensors to detect the user's emotions and displays appropriate advice.

[1599] Step 7: Emotional State Report

[1600] The device transmits the user's emotional state detected using the emotion engine to the server. The input data is the user's emotional data obtained in step 6, and the output data is the emotional state information to be transmitted to the server. In this process, the device transfers the emotional data to the server via a communication protocol.

[1601] Step 8: Send your feedback

[1602] The device sends user feedback to the server. The input data is the evacuation completion report and emotional feedback from the user, and the output data is the feedback information to be sent to the server. In this process, the user inputs feedback through the device interface, and the device sends it to the server.

[1603] Through these steps, a system will be realized that allows users to take prompt and appropriate evacuation actions in the event of a disaster and receive support according to their emotions.

[1604] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1605] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1606] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1607] [Fourth embodiment]

[1608] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1609] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1610] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1611] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1612] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1613] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1614] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1615] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1616] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1617] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1618] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1619] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1620] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1621] This paper describes a system that collects data, analyzes it, and notifies the results to user devices in real time. The system is intended to support evacuation in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[1622] Server Processing

[1623] 1. Data Collection

[1624] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[1625] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[1626] 2. Data Analysis

[1627] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[1628] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[1629] 3. Individual support information generation

[1630] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[1631] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[1632] 4. Notification sending

[1633] The server notifies the user device of analysis results and evacuation instructions in real time.

[1634] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[1635] Terminal handling

[1636] 1. Receiving notifications

[1637] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[1638] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[1639] 2. Information display

[1640] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[1641] - Example: The device displays the safest evacuation route on a map.

[1642] 3. Two-way communication

[1643] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[1644] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[1645] User behavior

[1646] 1. Initial Setup

[1647] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[1648] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[1649] 2. Emergency Response

[1650] Users can quickly take evacuation action by following the notifications on their devices.

[1651] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[1652] 3. Reporting completion of evacuation

[1653] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[1654] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[1655] Specific examples

[1656] 1. Scenario: Evacuation immediately after an earthquake occurs

[1657] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[1658] - The device receives evacuation warnings from the server and notifies the user via push notification.

[1659] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[1660] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[1661] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" helps users take swift and appropriate evacuation actions. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operations are described in detail in the processing steps below.

[1662] The processing flow will be explained below.

[1663] Step 1: Initial Setup (Normal)

[1664] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information, etc.).

[1665] Step 2: Upload your information

[1666] The terminal sends the information entered by the user to the server, and the terminal uploads the user data to the server using a secure communication protocol (e.g., HTTPS).

[1667] Step 3: Update the database

[1668] The server stores the received information in a database. The server creates a new user entry in the database and stores the personal information.

[1669] Step 4: Periodic data collection

[1670] The server periodically collects data from various sources, such as the Japan Meteorological Agency API, traffic information API, and evacuation shelter information API.

[1671] Step 5: Analyze and save

[1672] The server analyzes the collected data and stores the necessary information in a database. The server also stores new earthquake risk assessments and evacuation shelter status information.

[1673] Step 6: Update information

[1674] The device periodically retrieves data from the server and stores it in local storage. The device queries the server daily or at a specified frequency and stores the latest information locally.

[1675] Step 7: Obtain emergency information

[1676] The server immediately obtains earthquake occurrence information. The server receives immediate notification when an earthquake occurs via the Japan Meteorological Agency's real-time API.

[1677] Step 8: Real-time analysis

[1678] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity and impact area of ​​the earthquake and identify areas where evacuation warnings are required.

[1679] Step 9: Generate notifications

[1680] The server generates evacuation advisory notices based on the analysis results. The server creates notices for highly affected areas that include specific evacuation instructions and information on safe evacuation routes.

[1681] Step 10: Send emergency notifications

[1682] The server sends an emergency notification to the device. The server uses a push notification service (e.g., Firebase Cloud Messaging) to send the emergency notification to the user's device in real time.

[1683] Step 11: Receiving and viewing notifications

[1684] The device receives the emergency notification from the server and displays it to the user. The device notifies the user of the emergency information using a voice alert or push notification.

[1685] Step 12: Check evacuation instructions

[1686] The user checks the notification on the device and begins the specified evacuation action. The user then checks the evacuation route and location information of the evacuation shelter on the device screen.

[1687] Step 13: Evacuation

[1688] The user follows the evacuation route indicated by the device and moves to a safe location. The user heads to the designated evacuation shelter using the map and route information displayed on the device as a reference.

[1689] Step 14: Evacuation completion report

[1690] When the user has completed evacuation, they press the evacuation completion button on their device. When the user arrives at the evacuation shelter, they tap the evacuation completion button in the app.

[1691] Step 15: Submitting the completed information

[1692] The terminal sends an evacuation completion report to the server. The terminal sends the evacuation completion information to the server along with the user's location data.

[1693] Step 16: Database Update

[1694] The server stores the evacuation completion information in a database and manages the evacuation situation. The server updates the evacuation situation map in real time based on the received evacuation completion data.

[1695] Example 1

[1696] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1697] In modern society, rapid and accurate information provision and evacuation instructions are required when a disaster occurs. However, conventional systems can be slow in collecting and analyzing information, making it difficult for users to take appropriate evacuation actions. Another problem is that support tailored to each user's individual situation is not provided adequately. In particular, it has been technically difficult to provide analysis results and issue individual evacuation instructions in real time. There is a need for a system that can solve these issues.

[1698] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1699] In this invention, the server includes a means for collecting information, a means for analyzing the collected information, and a means for notifying a user terminal of the analysis results in real time. This allows users to receive prompt and accurate information and take appropriate evacuation actions. The server also includes a means for collecting information from various sources in an emergency, a means for predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users, a means for registering personal information of users in normal times, a means for generating individual evacuation instructions and support information in the event of a disaster, and a means for reporting the user's status to the server, thereby providing support tailored to each user's individual situation. Furthermore, the user terminal includes a means for receiving emergency notifications from the server and presenting them to the user, a means for transmitting user feedback to the server, and a means for periodically updating the user terminal with the latest evacuation information. This allows users to always receive the latest and most reliable information and encourage appropriate evacuation actions.

[1700] - "Means of collecting information" refers to the system for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[1701] "Means for analyzing collected information" refers to algorithms and software that use the acquired data to predict the extent of the disaster's impact and damage.

[1702] "Means for notifying the user terminal of the analysis results in real time" refers to a communication means for instantly transmitting the analyzed data to the user's device.

[1703] "A means of predicting the scope of impact and damage of an emergency and generating appropriate evacuation instructions for users" is a system for assessing the impact of a disaster when it occurs and instructing users on the most appropriate course of action.

[1704] "Means for registering users' personal information in peacetime" refers to a system for registering personal information such as users' addresses and emergency contact details before a disaster occurs.

[1705] "Means for generating individual evacuation instructions and support information in the event of a disaster" refers to a system that provides information on appropriate evacuation routes and evacuation locations in the event of a disaster, based on information registered in advance by the user.

[1706] "Means for reporting the user's status to the server" refers to a communication means for transmitting the user's current location and evacuation status to the server, and for the server to grasp this information.

[1707] "Means for the user terminal to receive emergency notifications from the server and present them to the user" refers to a mechanism by which the user's device receives emergency information sent from the server and provides feedback to the user.

[1708] "Means for sending user feedback to the server" refers to a mechanism for sending information and status reports provided by users to the server.

[1709] "Means for regularly updating the latest evacuation information to user devices" refers to a system that regularly delivers the latest evacuation information to users' devices and keeps the information up to date.

[1710] This invention relates to a system that provides evacuation instructions and support information quickly and accurately in the event of an emergency such as a natural disaster. This system is composed of three main elements: a server, terminals, and users, each of which fulfills a specific role to function as a whole.

[1711] Server embodiment

[1712] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources. This data is collected using Python scripts that retrieve information from external data providers such as the Japan Meteorological Agency's API. The data obtained is in JSON format and stored in the server's database.

[1713] The server then analyzes the collected data in real time. It uses Python libraries such as Pandas and NumPy to create data frames, and uses statistical processing and machine learning models to predict the extent of the disaster's impact and damage. The analysis results are then used to generate appropriate evacuation instructions for users.

[1714] Furthermore, the server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times. Specifically, it uses the Geopandas library to identify the nearest evacuation shelter and safe evacuation route from the user's address information using GIS data.

[1715] Finally, the server notifies the user device in real time of the analysis results and evacuation instructions using Firebase Cloud Messaging (FCM), and the server calls the FCM API to send push notifications.

[1716] Terminal embodiment

[1717] The device receives notifications from the server and notifies the user via push notifications or voice alerts. For example, on Android devices, notifications are received using Firebase's notification manager. If an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency alert.

[1718] The device also displays the received evacuation and support information in an easy-to-understand manner to the user. By using the Google Maps API, evacuation routes are visually displayed on a map, allowing users to easily check their evacuation routes.

[1719] The device also sends user feedback to the server, allowing the server to understand the user's current location and evacuation status in real time and provide additional assistance information as needed.When the user presses the evacuation completion button, the device sends an HTTP request to the server, updating the status in the database.

[1720] User's embodiment

[1721] Users register their personal information with the application during normal times, including their name, address, emergency contact information, etc. This information is stored on the device and securely transferred to the server when necessary.

[1722] When an emergency occurs, the user quickly takes evacuation action according to the notification from the device. For example, the user checks the notification on the device and moves to a safe shelter according to the evacuation route displayed. After completing the evacuation, the user presses the evacuation completion button on the device to report to the server.

[1723] Specific examples

[1724] Example prompt:

[1725] "Please tell me the evacuation route immediately after an earthquake occurs. Please suggest the optimal evacuation route based on the information obtained from the server."

[1726] In response to such prompts, the system generates the optimal evacuation route in real time based on the user's current location and information on the nearest evacuation shelter, and notifies the user. The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area, and the device receives evacuation advisories from the server and notifies the user via push notification. The user checks the notification on their device, takes the specified evacuation action, and after arriving at the evacuation shelter, presses the evacuation completion button to report to the server.

[1727] As a result, the system of the present invention can provide prompt and accurate evacuation support in the event of a disaster, thereby minimizing damage.

[1728] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1729] Step 1: Gather information

[1730] Input: Real-time data provided by APIs from external sources (such as the Japan Meteorological Agency and traffic information providers)

[1731] Specific operation: The server periodically executes a Python script and sends requests to the Japan Meteorological Agency's API, which retrieves data in JSON format, such as earthquake, weather, traffic, and evacuation shelter information. The server automatically collects this data and stores it in a database.

[1732] Output: Various disaster-related data stored in the database

[1733] Step 2: Data analysis

[1734] Input: Collected data stored in a database

[1735] Specific operation: The server uses Python's Pandas and NumPy libraries to create a data frame. Based on this, statistical processing and machine learning models are applied to predict the extent of the disaster impact and damage. For example, earthquake data is analyzed to calculate the epicenter, magnitude, and damage forecast.

[1736] Output: Analysis results (e.g., risk of building collapse in a specific area, evacuation advisories)

[1737] Step 3: Generate personalized support information

[1738] Input: User's registered personal information (address, emergency contact, etc.) and analysis results

[1739] Specific operation: The server uses the user's personal information acquired during normal times to identify the best evacuation shelter and safe evacuation route using libraries such as Geopandas. For example, it searches for the nearest evacuation shelter based on the user's address information and generates a route to that shelter.

[1740] Output: Individual evacuation instructions and support information (e.g., evacuation shelter list, evacuation route)

[1741] Step 4: Send notification

[1742] Input: Individual evacuation instructions and support information

[1743] Specific operation: The server uses Firebase Cloud Messaging (FCM) to send notifications to the user's device in real time. It calls the FCM API and sends appropriate evacuation warnings and route information to the user via push notifications.

[1744] Output: Evacuation notification sent to user device

[1745] Step 5: Receive notifications

[1746] Input: Notification sent from the server

[1747] Specific operation: The device receives notifications from the FCM and displays alerts and push notifications to the user. For example, if an earthquake alert is received late at night, the smartphone will vibrate and sound an emergency notification to the user.

[1748] Output: Urgent notification displayed on the user's screen

[1749] Step 6: Display information

[1750] Input: Received evacuation instructions and assistance information

[1751] How it works: The device uses the Google Maps API to visually display evacuation routes, allowing users to identify safe evacuation routes and the location of evacuation shelters.

[1752] Output: Evacuation route and shelter information displayed on the device screen

[1753] Step 7: Two-way communication

[1754] Input: User feedback (e.g., information on pressing the evacuation complete button)

[1755] Specific operation: When a user arrives at a shelter and presses the "Evacuation Complete" button on their device, that information is sent to the server as an HTTP request. The server receives this information and updates the database.

[1756] Output: Evacuation completion information sent to the server

[1757] Step 8: Initial Setup

[1758] Input: User's personal information (name, address, emergency contact, etc.)

[1759] Specific operation: The user enters the necessary information on the app's settings screen, which is saved on the device. The data is then transferred to the server via secure communication and registered in the database.

[1760] Output: Personal information of registered users

[1761] Step 9: Emergency response

[1762] Input: Evacuation information received from the server

[1763] Specific actions: The user checks the notification on the device and takes prompt action to evacuate by following the displayed evacuation route. Specifically, the user follows the evacuation route on the map and moves to a safe evacuation shelter.

[1764] Output: User's evacuation behavior

[1765] Step 10: Evacuation completion report

[1766] Input: User's evacuation completion operation (pressing the evacuation completion button)

[1767] Specific operation: When the user arrives at the evacuation shelter and presses the evacuation completion button, the device sends the information to the server. The server receives this report and updates the database to record the evacuation completion status.

[1768] Output: Evacuation completion information recorded on the server

[1769] (Application example 1)

[1770] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1771] To enable autonomous vehicles and other mobile devices to evacuate quickly and efficiently in the event of a disaster, a system is needed that can obtain disaster information in real time, provide optimal evacuation routes, and automatically follow those routes. It is also necessary to grasp the user's evacuation status in real time and provide additional assistance. Conventional systems do not integrate these functions, making it difficult for users to evacuate quickly and effectively.

[1772] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1773] In this invention, the server includes a means for collecting data, a means for analyzing the collected data, and a means for notifying the user device of the analysis results in real time. This enables real-time acquisition and analysis of disaster information and provision of optimal evacuation routes during disasters. Furthermore, this invention also includes a means for displaying optimal evacuation routes for mobile objects based on the analysis results, and a means for the mobile object to automatically move along the evacuation route. This enables self-driving vehicles and other mobile objects to evacuate quickly and efficiently.

[1774] "Means of collecting data" refers to systems and methods for obtaining data on earthquakes, weather, traffic, evacuation shelters, etc. from various sources.

[1775] "Means for analyzing collected data" refers to systems and methods for analyzing acquired data and predicting the extent of the impact and damage of a disaster.

[1776] "Means for notifying a user device of analysis results in real time" refers to a system or method for instantly delivering and notifying a user device of analysis results.

[1777] "Means for displaying the optimal evacuation route for a moving object based on the analysis results" refers to a system or method for presenting the optimal evacuation route for a moving object based on analyzed evacuation information.

[1778] "Means for a mobile body to automatically move along an evacuation route" refers to a system or method in which a mobile body automatically operates along a presented optimal evacuation route.

[1779] "Means for registering users' personal information in peacetime" refers to systems and methods for registering users' personal information in a database before a disaster occurs.

[1780] "Means for providing individual evacuation instructions based on user registration information in an emergency" refers to a system or method that uses user registration information to provide individually customized evacuation instructions in the event of a disaster.

[1781] "Means for reporting the user's evacuation status to the server" refers to a system or method for transmitting and reporting the user's evacuation status to the server.

[1782] "Means for monitoring evacuation situations in real time and providing additional support information" refers to a system or method for monitoring a user's evacuation situation in real time and providing any additional support that is required.

[1783] "Means for regularly updating the latest evacuation information to the user's device" refers to a system or method for regularly updating the latest evacuation information to the user's device.

[1784] "Means for a device to receive an emergency notification from a server and display it to a user" refers to a system or method in which a device receives an emergency message from a server and displays an alert to a user.

[1785] "Means for transmitting user feedback to a server" refers to a system or method for transmitting user-provided information or feedback to a server.

[1786] "Means for notifying the server of the evacuation completion status of a mobile body in an emergency" refers to a system or method for reporting to the server that the evacuation of a mobile body has been completed in an emergency.

[1787] This invention is a system that supports autonomous vehicles and other mobile objects to evacuate quickly and efficiently in the event of a disaster. Here, we will explain the roles of the server, terminal, and user, as well as the specific implementation method of the entire system.

[1788] Server Processing

[1789] 1. Data Collection

[1790] The server periodically obtains data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources using APIs. This process is achieved using a programming language such as Python and a library for making HTTP requests (e.g., requests).

[1791] 2. Data Analysis

[1792] The collected data is analyzed in real time to predict the extent of the disaster impact and damage. This is done using machine learning models and data analysis libraries (e.g., scikit-learn). Based on the analysis results, the optimal evacuation route is calculated.

[1793] 3. Sending notifications

[1794] The analysis results are sent to the user's device in real time using a push notification service (e.g., Firebase Cloud Messaging).

[1795] Terminal handling

[1796] 1. Receiving notifications

[1797] The terminal receives notifications from the server and notifies the user via push notifications or audio alerts. This role is played by user devices such as smartphones or head-mounted displays (HUDs).

[1798] 2. Information display

[1799] The device will then display the received evacuation information in an easy-to-understand manner. In particular, the HUD of the autonomous vehicle will display evacuation routes. This will be done using a map display library (e.g., Google Maps API).

[1800] 3. Two-way communication

[1801] The device sends user feedback to a server and monitors the evacuation situation in real time, allowing it to provide additional assistance if needed.

[1802] User Behavior

[1803] 1. Initial Setup

[1804] Users register their personal information in normal times using a smartphone app or web interface.

[1805] 2. Emergency Response

[1806] Users receive notifications from their devices and follow instructions to quickly take evacuation action. In the case of autonomous vehicles, the vehicles will automatically begin moving along the evacuation route provided.

[1807] 3. Reporting completion of evacuation

[1808] When the user arrives at the evacuation shelter, they press the evacuation completion button on their device to report to the server. This information is used to appropriately plan the next evacuation measures.

[1809] Specific examples

[1810] For example, if an earthquake occurs while a user is in an autonomous vehicle, the system immediately obtains the latest disaster information and calculates and displays the optimal evacuation route. The autonomous vehicle then automatically begins driving and continues to a safe evacuation shelter. After arriving at the evacuation shelter, the user can use their device to report the completion of evacuation to the server, and the server can use that information to provide additional assistance.

[1811] Prompt Sentence Examples

[1812] "Design an application that provides detailed earthquake information, calculates and displays the route from your current location to the best evacuation shelter, and includes a function that allows an autonomous vehicle to automatically evacuate by following that route."

[1813] The above is a specific embodiment of the disaster evacuation support system of the present invention, which enables users to evacuate quickly and efficiently based on real-time disaster information.

[1814] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1815] Processing steps and specific operations

[1816] Step 1:

[1817] The server periodically collects data on earthquakes, weather, traffic, evacuation shelters, etc. from various information sources via API. Specifically, it sends HTTP requests to API endpoints such as those of the Japan Meteorological Agency and traffic information providers, and obtains the returned JSON data. This collected data becomes the input for processing and is stored internally on the server.

[1818] Step 2:

[1819] The server analyzes the collected data in real time, using machine learning generative AI models and data analysis libraries (e.g., scikit-learn). The purpose of the analysis is to predict the extent of the disaster's impact and damage, using collected weather and earthquake information as input data, and then outputting specific analysis results such as evacuation routes.

[1820] Step 3:

[1821] The server then sends real-time evacuation information to the user device based on the analysis results. This notification is sent using a push notification service (e.g., Firebase Cloud Messaging). Specifically, the server formats the analysis results and sends a push notification specifying the user device's identifier. During this process, the notification content is generated as output data.

[1822] Step 4:

[1823] The device receives the notification sent from the server and notifies the user. Specifically, a smartphone or head-mounted display (HUD) receives a push notification and displays it to the user as an audio alert or a pop-up on the screen. This notification becomes input data and is output in the form of an alert display.

[1824] Step 5:

[1825] The device displays the optimal evacuation route to the user. A map display library (e.g., Google Maps API) is used to display the evacuation route. After receiving the push notification, the device obtains the evacuation route information as an analysis result and displays it on the device screen or HUD. The input of this process is the notification from the server, and the output is a visual representation of the evacuation route.

[1826] Step 6:

[1827] The autonomous vehicle automatically begins moving according to the displayed evacuation route. The vehicle's autonomous driving system manages this process and generates the control signals necessary to operate according to the evacuation route. The input is the evacuation route information, and the output is the movement of the vehicle.

[1828] Step 7:

[1829] The device reports the user's evacuation completion status to the server. Specifically, when the user arrives at the evacuation shelter and presses the evacuation completion button on the device, a message indicating evacuation completion is sent to the server. The input is the user's operation, and the output is the report data.

[1830] Step 8:

[1831] The server receives the evacuation completion report and provides additional support information as needed. This support information is generated using a generative AI model based on the latest situation and notified to the user device. The input is the evacuation completion report data, and the output is the support information.

[1832] Through the above processing steps, the disaster evacuation support system of the present invention supports mobile bodies, including autonomous vehicles, in taking evacuation actions quickly and efficiently.

[1833] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1834] This invention combines a system that collects data, analyzes it, and notifies the user device of the results in real time with an emotion engine that recognizes the user's emotions and provides evacuation instructions and support information based on those emotions. The aim is to help users receive appropriate information and take swift and calm evacuation action, particularly in the event of a disaster. The system consists of three main elements: a server, a terminal, and a user, to which the emotion engine is added.

[1835] Server Processing

[1836] 1. Data Collection

[1837] The server periodically collects data from various sources, such as earthquakes, weather, traffic, and evacuation shelters, using APIs.

[1838] - Example: The server retrieves the latest earthquake information from the Japan Meteorological Agency's API.

[1839] 2. Data Analysis

[1840] The server analyzes the collected data in real time, predicts the extent of the disaster's impact and damage, and generates appropriate evacuation instructions for users based on the results of this analysis.

[1841] - Example: The server evaluates the risk of building collapse in a specific area based on the earthquake information it obtains.

[1842] 3. Individual support information generation

[1843] The server generates individual evacuation instructions and support information in the event of a disaster based on the personal information of users registered during normal times.

[1844] - Example: Based on the address information registered by the user, the server generates a list of evacuation shelters that are scheduled to open in the area.

[1845] 4. Notification sending

[1846] The server notifies the user device of analysis results and evacuation instructions in real time.

[1847] - Example: After an earthquake occurs, the server promptly sends appropriate evacuation route and shelter information to the user.

[1848] 5. Emotional Data Analysis

[1849] The server analyzes the data from the emotion engine and generates additional support information and advice based on the user's emotional state.

[1850] - Example: The server provides advice on how to relax if the user is feeling stressed.

[1851] Terminal handling

[1852] 1. Receiving notifications

[1853] The device receives notifications from the server and notifies the user via push notifications or audio alerts.

[1854] - Example: The device receives an earthquake alert in the middle of the night and displays an emergency alert on the user's smartphone.

[1855] 2. Information display

[1856] The device displays the received advice on actions and evacuation information in an easy-to-understand manner.

[1857] - Example: The device displays the safest evacuation route on a map.

[1858] 3. Emotional state monitoring

[1859] The device monitors the user's emotional state in real time and provides advice and messages to calm the emotions as needed.

[1860] - Example: The device can recognize the user's facial expressions and suggest relaxation techniques if they are feeling anxious.

[1861] 4. Emotional State Report

[1862] The device uses an emotion engine to detect the user's emotional state and transmits it to the server.

[1863] - Example: The device sends information about the user's stress to the server.

[1864] 5. Two-way communication

[1865] The device sends user feedback to the server, allowing the server to understand the user's evacuation status and provide additional assistance if necessary.

[1866] - Example: The terminal sends information to the server that the user has pressed the evacuation completion button.

[1867] User behavior

[1868] 1. Initial Setup

[1869] Users register their personal information during normal times and store it on their devices, which allows them to receive prompt and appropriate assistance in the event of a disaster.

[1870] - Example: A user enters information for everyone in their household into the app and sets up a contact list in case of an emergency.

[1871] 2. Emergency Response

[1872] Users can quickly take evacuation action by following notifications on their device, and calm down by following advice on the device.

[1873] - Example: The user follows the evacuation route presented by the AI ​​and moves quickly to a safe shelter.

[1874] 3. Reporting completion of evacuation

[1875] Once the evacuation is complete, the user presses the evacuation completion button on the device to report it.

[1876] - Example: After arriving at the evacuation shelter, the user presses the evacuation completion button on the app to report to the server.

[1877] Specific examples

[1878] 1. Scenario: Evacuation immediately after an earthquake occurs

[1879] - The server obtains earthquake information from the Japan Meteorological Agency and analyzes the risk in the relevant area.

[1880] - The device receives evacuation warnings from the server and notifies the user via push notification.

[1881] - The user checks the notification on the device and begins the specified evacuation action. The user looks at the device screen, selects a safe evacuation route, and moves to the evacuation shelter.

[1882] - The user arrives at the evacuation shelter and presses the evacuation completion button on the device to report the completion of evacuation to the server.

[1883] - The device monitors the user's emotional state and provides relaxation advice if they are feeling stressed.

[1884] Through these processes, the GTPs-based disaster evacuation support AI "co-pilot" supports swift and appropriate evacuation actions while taking into account the user's emotional state. It can reliably provide necessary information even in a chaotic information environment, minimizing damage. Specific operating procedures and system operation are described in detail in the processing steps below.

[1885] The processing flow will be explained below.

[1886] Step 1: User Registration

[1887] The user installs the app and performs initial registration. The user enters personal information (name, address, contact information, health information).

[1888] Step 2: Send information

[1889] The device sends the information entered by the user to the server. The device transmits the data securely using HTTPS.

[1890] Step 3: Update the database

[1891] The server stores the received user information in a database. The server creates a new user entry and stores the personal information securely.

[1892] Step 4: Data collection during normal times

[1893] The server periodically collects earthquake information, weather information, traffic information, evacuation shelter information, etc. from related organizations. The server obtains the latest information using API.

[1894] Step 5: Data analysis during normal times

[1895] The server analyzes the collected data and stores the necessary information in a database. The server updates the database with new risk assessments and shelter status information.

[1896] Step 6: Update information

[1897] The device retrieves data from the server and stores it in local storage. The device queries the server at a specified frequency and downloads the latest information.

[1898] Step 7: Obtain emergency information

[1899] The server obtains earthquake occurrence information in real time. The server receives earthquake information via the Japan Meteorological Agency's real-time API.

[1900] Step 8: Real-time data analysis

[1901] The server analyzes the impact area and damage predictions in real time based on earthquake information. The server uses an AI model to calculate the seismic intensity an...

Claims

1. a means of collecting data; a means for analyzing the collected data; A means of notifying the user device of the analysis results in real time; A system including:

2. A means of registering users' personal information in normal times, A means for providing individual evacuation instructions based on user registration information in the event of an emergency; a means for reporting the evacuation status of the user to the server; The system of claim 1 , comprising:

3. A means to regularly update the latest evacuation information to users' devices, a means for the terminal to receive an emergency notification from the server and display it to the user; a means for transmitting user feedback to a server; The system of claim 1 , comprising:

Images