system
The system addresses the lack of rapid evacuation guidance and supply delivery during earthquakes by providing real-time information, shelter location, and supply management, ensuring timely and efficient support for disaster victims.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-30
- Publication Date
- 2026-04-09
AI Technical Summary
Existing systems fail to provide rapid and accurate evacuation information and supply delivery during earthquakes, leading to delays in necessary supplies reaching affected areas.
A system that collects real-time earthquake information, identifies the user's location, searches for optimal evacuation shelters, notifies users, matches supply needs with inventory, selects available supplies, and arranges for their delivery to ensure timely procurement and distribution.
Ensures that disaster victims receive appropriate evacuation information and necessary supplies are supplied quickly and efficiently during earthquakes.
Smart Images

Figure 2026062135000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] At the time of an earthquake, there is a lack of means for providing information for users to evacuate quickly and appropriately. Also, there is a problem that a system for smoothly procuring and delivering necessary supplies in the evacuation area has not been established. As a result, problems occur such that disaster victims cannot obtain accurate evacuation information or the required supplies do not arrive quickly.
Means for Solving the Problems
[0005] This invention solves the above problems by providing a system that collects earthquake information in real time, searches for the optimal evacuation shelter based on the user's current location, and notifies the user of that information. Furthermore, by providing a system that matches the needs of the affected area with inventory data, generates a list of necessary supplies, selects available supplies, aggregates them, and arranges for delivery, it enables rapid procurement and delivery of supplies to evacuation areas. Specifically, the invention provides a system that includes the following means:
[0006] 1. Means of collecting earthquake information in real time
[0007] 2. Means for obtaining the user's current location information
[0008] 3. Means for searching for evacuation shelters based on the current location information.
[0009] 4. Means for notifying users of information regarding the aforementioned evacuation shelters.
[0010] 5. Means of providing map information for navigating to evacuation shelters.
[0011] 6. A means of matching the needs of the affected area with inventory data and generating a list of necessary supplies.
[0012] 7. Means of selecting available supplies
[0013] 8. A means of compiling information on the provision of supplies and arranging delivery.
[0014] 9. A means of receiving information on supplies provided by users outside the affected area and arranging for their delivery to evacuation centers.
[0015] The aim of these measures is to ensure that disaster victims receive appropriate evacuation information and that necessary supplies are supplied quickly.
[0016] "Earthquake information" refers to various data related to earthquakes, such as the time of occurrence, epicenter, seismic intensity, and other earthquake-related information.
[0017] "User" refers to individuals or organizations that seek evacuation information and necessary supplies information during an earthquake.
[0018] "Current location information" refers to the real-time location data of the user obtained using GPS or other location information technologies.
[0019] "Evacuation site" refers to a designated place where residents take temporary shelter during an earthquake.
[0020] "Notification" refers to messages or alerts for the system to inform users of information.
[0021] "Real-time" means that information is collected and processed immediately and provided to users almost simultaneously.
[0022] "Necessary supplies list" refers to a list that summarizes the types and quantities of supplies required in the evacuation area.
[0023] "Available supplies" refers to supplies that users outside the affected area can supply to the evacuation area.
[0024] "Aggregation" means unifying the provided supply information and analyzing and organizing it.
[0025] "Delivery arrangement" refers to the procedure of aggregating necessary supplies, calculating the optimal delivery route and method, and performing actual delivery.
[0026] "Needs" refer to specific requirements for supplies and services lacking in the evacuation area.
Brief Description of Drawings
[0027] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]
[0028] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.
[0029] First, let's explain the terminology used in the following explanation.
[0030] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).
[0031] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.
[0032] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.
[0033] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0034] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0035] [First Embodiment]
[0036] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0037] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0038] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0039] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0040] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0041] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0042] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0043] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0044] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0045] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0046] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0047] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0048] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake. This system consists of the interaction of a server, terminals, and users.
[0049] Program Overview
[0050] The following programs are executed on this system:
[0051] Collection of earthquake information
[0052] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0053] Acquiring user location information and searching for evacuation shelters
[0054] When an earthquake occurs, the user launches a smartphone app. The device uses its GPS function to obtain its current location and sends this information to the server. Based on the received location information, the server searches its database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[0055] Notification of information about evacuation shelters
[0056] The server notifies the user's device of information regarding recommended evacuation locations (e.g., the name of the evacuation center, its address, and its distance from the user's current location). This notification also includes detailed map information to the evacuation center, allowing the user to head to the location based on this information.
[0057] Generating a list of necessary supplies and managing the supplies provided.
[0058] The server matches the needs of the evacuation area with inventory data and creates a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[0059] Tallying and arranging the delivery of donated supplies
[0060] The server aggregates information on the donated supplies and verifies whether all necessary items are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the supplies to be delivered. This ensures that necessary supplies reach evacuation areas quickly.
[0061] Specific example
[0062] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." User A clicks the provided link and evacuates while checking map information to the shelter.
[0063] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0064] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, ensuring that users can obtain appropriate evacuation information and that necessary supplies are supplied quickly.
[0065] The following describes the processing flow.
[0066] Specific processing of the program
[0067] Processing related to evacuation orders
[0068] Step 1:
[0069] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0070] Step 2:
[0071] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[0072] Step 3:
[0073] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations are used.
[0074] Step 4:
[0075] Terminal: Sends the acquired current location information to the server.
[0076] Step 5:
[0077] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. When selecting an evacuation shelter, it considers the shelter's capacity and current congestion level.
[0078] Step 6:
[0079] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[0080] Step 7:
[0081] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[0082] Step 8:
[0083] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[0084] Step 9:
[0085] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[0086] Processing of requests for necessary supplies
[0087] Step 1:
[0088] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[0089] Step 2:
[0090] Server: Verify the user's authentication information and grant permission to log in.
[0091] Step 3:
[0092] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[0093] Step 4:
[0094] Server: Presents the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[0095] Step 5:
[0096] User: Select the supplies you can provide (e.g., 10 liters of drinking water, 5 blankets) and enter the information.
[0097] Step 6:
[0098] Terminal: Sends the entered supply provision information to the server.
[0099] Step 7:
[0100] Server: Aggregates the provided supply information and verifies that sufficient supplies are available. Furthermore, it develops the optimal delivery plan based on the provided supplies.
[0101] Step 8:
[0102] Server: Calculates the optimal delivery route and method, and arranges the delivery of goods. This process includes coordinating with logistics providers and setting delivery priorities.
[0103] Step 9:
[0104] Server: Notifies the supply provider that delivery arrangements are complete. This notification includes the scheduled delivery date and time and tracking information.
[0105] In this way, this system enables rapid evacuation support and efficient supply of necessary goods during earthquakes.
[0106] (Example 1)
[0107] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0108] When an earthquake strikes, it is crucial to quickly and accurately gather information and provide appropriate evacuation guidance to users. Furthermore, effectively supplying necessary goods to evacuation areas is also a critical issue. However, conventional systems struggled to handle such a comprehensive response, sometimes resulting in delays in information and shortages of supplies. This made it difficult to ensure the safety of evacuees and provide rapid assistance.
[0109] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0110] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation sites based on the current location information, means for notifying the user's terminal of information regarding the evacuation sites, means for matching demand and inventory data of the evacuation area and generating a list of necessary supplies, means for allowing the user to select available supplies, and means for aggregating supply provision information and arranging delivery. This enables rapid and accurate evacuation guidance and supply of goods in the event of an earthquake.
[0111] "Earthquake information" refers to data that includes information such as the time of the earthquake, the epicenter, and the seismic intensity.
[0112] "Methods for collecting data in real time" refers to methods for instantly acquiring earthquake information and storing it in a database.
[0113] A "user" refers to an individual or group that uses the system.
[0114] "Current location information" refers to data that includes the latitude and longitude of the user's current location.
[0115] "Means of obtaining current location information" refers to methods of obtaining a user's current location information using technologies such as GPS.
[0116] A "shelter" refers to a place where people can ensure their safety during an earthquake, such as a shelter or temporary evacuation site.
[0117] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[0118] "Information regarding evacuation shelters" refers to detailed information such as the name of the evacuation shelter, its address, distance from your current location, and its capacity.
[0119] "Means for notifying users of evacuation shelters on their devices" refers to means for transmitting information about evacuation shelters to users' devices.
[0120] An "evacuation zone" is an area affected by an earthquake where evacuation is necessary.
[0121] "Demand" refers to the amount of goods and services needed in an evacuation zone.
[0122] "Inventory data" refers to information about the stock of goods and services that can be supplied.
[0123] A "list of necessary supplies" is a list that shows a list of supplies needed in an evacuation area.
[0124] "Means of allowing users to select available supplies" refers to methods of allowing users to select the supplies they can provide and transmitting that information to the system.
[0125] "Information on the provision of goods" refers to detailed information (type, quantity, etc.) about the goods provided by users.
[0126] "Means for aggregating information on the provision of supplies and arranging delivery" refers to means for efficiently delivering necessary supplies based on the aggregated information on the provision of supplies.
[0127] "Map information" refers to geographical guidance information necessary for users to find their way to an evacuation site.
[0128] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake, and consists of the interaction of a server, terminals, and users. This system makes it possible to collect earthquake information in real time, provide appropriate evacuation information to users, and rapidly supply necessary goods.
[0129] Collection of earthquake information
[0130] The server collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency. This process involves sending HTTP requests and parsing the JSON data received as responses. Specific data includes the time of the earthquake, its epicenter, and its seismic intensity. The collected data is stored in a MySQL® database.
[0131] Obtaining user location information
[0132] When an earthquake occurs, the user launches a dedicated smartphone app. The device (smartphone) obtains GPS data through location services. The obtained location data (latitude and longitude) is sent to a server via Firebase and stored in a database.
[0133] Search for evacuation shelters
[0134] The server searches its database for the nearest evacuation shelter based on the user's current location information. This process uses PostGIS to calculate geographical distances. From the calculation results, it retrieves detailed information such as the name, address, latitude, and longitude of the nearest evacuation shelter.
[0135] Notification of evacuation shelter information
[0136] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. This notification includes the name and address of the evacuation shelter, as well as map information including a link to Google Maps®. In this way, the user can confirm the route to the appropriate evacuation shelter.
[0137] Generating a list of necessary supplies
[0138] The server matches demand and inventory data for the evacuation area and generates a list of necessary supplies. Based on inventory data retrieved from the database, it creates a list of supplies needed in the evacuation area (e.g., drinking water, blankets, emergency food, etc.) and displays it on the system's web interface.
[0139] Management and tabulation of donated goods
[0140] Users (who are outside the evacuation zone) log in and select the supplies they can provide. The selected supply information is sent to the server and stored in the database. The server aggregates the supply information provided by each user and checks whether the necessary supplies have been collected.
[0141] Delivery arrangements
[0142] The server calculates the optimal delivery route based on the aggregated supply information. Based on the calculated delivery route, it arranges for the delivery of supplies through the APIs of partner logistics companies. Finally, it notifies the supply providers and the evacuation areas of the delivery status of the supplies.
[0143] Specific example
[0144] For example, suppose an earthquake occurs in Tokyo, and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app and requests evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that a "park" evacuation shelter in Chiyoda Ward is the most suitable evacuation location and notifies user A of this information. User A clicks on the map link and evacuates while checking the route to the evacuation shelter.
[0145] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0146] Example of a prompt
[0147] "An earthquake has occurred, and users need evacuation information. Please design a system that notifies users of the optimal evacuation location and route. Additionally, please add a mechanism to provide users outside the evacuation zone with information on necessary supplies and to arrange for their delivery."
[0148] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0149] Step 1:
[0150] The server collects earthquake information in real time. Specifically, it sends HTTP requests to APIs of information sources such as the Japan Meteorological Agency. The input includes the API endpoint URL and request parameters, and the output is earthquake information in JSON format. This received data contains information about the time of the earthquake, the epicenter, and the seismic intensity, which is parsed and stored in a MySQL database.
[0151] Step 2:
[0152] When an earthquake occurs, the user launches a smartphone app. The device (smartphone) obtains GPS data using location services. The input includes raw data from the GPS sensor, and the output is the latitude and longitude of the current location. This location information is sent to the server via Firebase. The server receives this data and stores it in a database.
[0153] Step 3:
[0154] The server searches for the nearest evacuation shelter from its database based on the user's current location information. Specifically, it uses PostGIS to calculate geographical distances based on the received latitude and longitude. The input includes the user's location information and database information on evacuation shelters, and the output provides the name, address, latitude, and longitude of the optimal evacuation shelter.
[0155] Step 4:
[0156] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. The input includes detailed information about the evacuation shelter (name, address, map link), and the output is a push notification of the evacuation shelter information sent to the user's smartphone. The notification also includes a detailed map link of the evacuation shelter, which the user can click to view the map information.
[0157] Step 5:
[0158] The server retrieves demand and inventory data for the evacuation area from a database and generates a list of necessary supplies. The input includes demand and inventory data for the evacuation area, and the output is a list of necessary supplies (e.g., drinking water, blankets, emergency food, etc.). This list is presented through the system's web interface.
[0159] Step 6:
[0160] Users (who are outside the evacuation zone) log in and select the supplies they can provide. Specifically, they enter details of the supplies they can provide via a web interface and submit them. The input includes the username, the type and quantity of supplies to be provided, and the information about the supplies provided is sent to the server and stored in the database.
[0161] Step 7:
[0162] The server checks whether all necessary supplies are available based on the aggregated supply information. Input includes supply information and required supply lists provided by each user, and output provides the total amount of supplies and a list of missing supplies. Based on this, the server calculates the optimal delivery route.
[0163] Step 8:
[0164] The server calculates the optimal delivery route and then arranges for the delivery of supplies through the API of a partner logistics company. Inputs include the delivery address, detailed information about the supplies, and optimal route information, and the output is the completion of the supply delivery arrangement. The delivery status is also monitored, and notifications are sent to the supply provider and the evacuation area.
[0165] (Application Example 1)
[0166] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0167] During an earthquake, rapid and accurate evacuation guidance is crucial. However, conventional systems are insufficient for real-time earthquake information gathering, user location acquisition, and shelter search and notification, often leading to delays in evacuation. Furthermore, the supply of necessary goods in evacuation areas may be delayed, posing a challenge in responding quickly to the needs of evacuees. In particular, rapid response is extremely important in the event of a large-scale earthquake, but conventional methods struggle to adequately achieve this.
[0168] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0169] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for generating a list of necessary supplies based on the needs of the evacuation area using a generative model, means for notifying the user of the generated evacuation shelter and necessary supplies information, and means for generating prompt sentences for input into the generative AI model. This enables rapid and accurate evacuation guidance and the rapid supply of supplies to meet the needs of the evacuation area in the event of an earthquake.
[0170] "Earthquake information" refers to information that includes data such as the time of the earthquake, the epicenter, and the seismic intensity.
[0171] "Real-time collection" means collecting information almost immediately after an earthquake occurs.
[0172] "User's current location information" refers to information about the user's current location, identified using means such as GPS.
[0173] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[0174] "Information regarding evacuation shelters" includes information such as the name of the evacuation shelter, its address, and its distance from your current location.
[0175] A "generative model" is an algorithm that generates the desired output based on a given set of input data.
[0176] A "list of necessary supplies" is a list of essential items generated by matching the needs of the evacuation area with inventory data.
[0177] "Information on the provision of supplies" refers to data regarding the types and quantities of supplies that can be provided.
[0178] "Delivery arrangements" refer to the procedures for ensuring that supplies are delivered quickly to designated evacuation areas.
[0179] A "generative AI model" is an artificial intelligence system designed to perform specific tasks or process data using machine learning techniques.
[0180] A "prompt statement" is an input statement to a generative AI model, in the form of instructions or questions to obtain the required output.
[0181] A system for carrying out this invention includes the following configuration.
[0182] System configuration and hardware / software used
[0183] 1. Servers: Cloud services such as AWS (registered trademark) and Google Cloud will be used for real-time data processing and database management. MySQL and PostgreSQL will be used as databases to store earthquake information, evacuation center information, and information on the provision of supplies.
[0184] 2. Earthquake Information Collection API: Using APIs from the Japan Meteorological Agency and other sources, data such as the time of earthquake occurrence, epicenter, and seismic intensity are obtained in real time.
[0185] 3. Smartphone device: Uses an iOS or Android® smartphone and obtains the user's current location information using GPS functionality. Data communication with the server is performed via internet connection and notification services.
[0186] 4. Generative AI Model: Using machine learning techniques, this model generates lists of necessary supplies based on the needs of evacuation areas and generates prompt messages. The model is built and operated using libraries such as TENSORFLOW® and PyTorch.
[0187] Processing flow
[0188] 1. Gathering earthquake information:
[0189] The server uses an earthquake information API to acquire earthquake data in real time and stores it in a database.
[0190] 2. Obtaining the user's location information:
[0191] Smartphones use GPS functionality to obtain the user's current location and send it to a server. This location information is used to search for evacuation shelters.
[0192] 3. Searching for and notifying evacuation shelters:
[0193] The server searches its database for the nearest evacuation shelter based on the user's current location. The server then notifies the user's smartphone of the shelter's information. The notification includes the shelter's name, address, distance from the user's current location, and route information.
[0194] 4. Generating a list of necessary supplies:
[0195] The server uses a generative AI model to match the needs of the evacuation area with inventory data and generate a list of necessary supplies. This list is provided to users in other regions and serves as a basis for selecting relief supplies.
[0196] 5. Management of supply information and arrangement of delivery:
[0197] The provided supply information is compiled on a server, the optimal delivery route is calculated, and arrangements are made with logistics companies. This ensures that supplies are delivered quickly.
[0198] Specific example
[0199] For example, if an earthquake occurs in Tokyo, the system will operate as follows:
[0200] (Example of a prompt message)
[0201] During an earthquake:
[0202] User's current location: Chiyoda-ku, Tokyo
[0203] Shelter search criteria: The shelter closest to the user.
[0204] Notification content: Detailed route information to the nearest evacuation shelter and evacuation destination.
[0205] Based on this prompt, the server retrieves information about the nearest evacuation shelter, "Chiyoda Park," and notifies the user. The notification includes the message, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." The user can click the provided link and evacuate while viewing map information to the shelter.
[0206] At the same time, users outside the evacuation zone are presented with a list of necessary supplies and can select the items they can provide and send them to the server. Based on this information, the server compiles the supplies, arranges for their delivery, and delivers them to the evacuation centers via the most optimal route.
[0207] In this way, this system enables rapid evacuation guidance and the supply of necessary goods to evacuation areas during earthquakes.
[0208] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0209] Step 1: Gathering earthquake information
[0210] The server calls the Japan Meteorological Agency's earthquake information API to obtain real-time data such as the time of earthquake occurrence, epicenter, and seismic intensity. The obtained data is stored in a MySQL or PostgreSQL database. The input is earthquake data obtained from the earthquake information API, and the output is earthquake information stored in the database.
[0211] Step 2: Obtaining the user's location information
[0212] The device (the user's smartphone) obtains its current location information using the built-in GPS function. The obtained location information is transmitted to the server via the internet. The input is the user's current location information obtained from GPS, and the output is the location information data transmitted to the server.
[0213] Step 3: Search for an evacuation shelter
[0214] The server uses the user's current location information to search the database for the nearest evacuation shelter. This uses an algorithm that calculates distance using the location information to identify the closest shelter. The input is the user's current location information, and the output is the nearest evacuation shelter information.
[0215] Step 4: Notification of evacuation shelter information
[0216] When the server retrieves information about the nearest evacuation shelter, it sends a notification to the user's device. The notification includes the name and address of the shelter, the distance from the current location, and detailed route information. Specifically, the server sends a push notification to the device. The input is the information about the nearest evacuation shelter, and the output is the notification message sent to the user.
[0217] Step 5: Generate a list of necessary supplies
[0218] The server uses a generative AI model to generate a list of necessary supplies based on the needs and inventory data of the evacuation area. Specifically, it optimizes the supply of goods to meet the estimated needs of the evacuation area. The input is the needs data and inventory data of the evacuation area, and the output is a list of necessary supplies.
[0219] Step 6: Choosing the Provision of Supplies
[0220] Users outside the evacuation zone log into the system using a terminal and select the supplies they can provide based on the list of necessary supplies provided by the server. The selection information is sent to the server. The input is the information of the supplies selected by the user, and the output is the information of the supplies provided that is sent to the server.
[0221] Step 7: Compiling information on supply provision and arranging delivery.
[0222] The server uses the collected supply information to verify that all necessary supplies are available and calculates the optimal delivery route. It then calls the logistics provider API to arrange the actual delivery. The input is the aggregated supply information, and the output is the delivery arrangement information sent to the logistics provider.
[0223] Step 8: Notification of the list of necessary supplies and shelter information.
[0224] The server generates prompt statements for input to the AI model, uses them to generate notification messages containing information on each evacuation center and necessary supplies, and sends them to personnel and support staff in the evacuation area. For example, a prompt statement like "When an earthquake occurs: User's current location: Chiyoda-ku, Tokyo; Evacuation center search criteria: Evacuation center closest to the user; Notification content: Detailed route information to the nearest evacuation center and evacuation destination" is used. The input is the prompt statement, and the output is the generated notification message.
[0225] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0226] This invention provides more personalized support by combining a system designed for rapid evacuation guidance and supply of necessary goods during an earthquake with an emotion engine that recognizes the user's emotions. This system consists of the interaction of a server, a terminal, and the user.
[0227] Program Overview
[0228] The following programs are executed on this system:
[0229] Collection of earthquake information
[0230] Server: Collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency, and stores various earthquake-related data (occurrence time, epicenter, seismic intensity, etc.) in a database.
[0231] Acquiring user location information and searching for evacuation shelters
[0232] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[0233] Device: Uses GPS functionality to obtain current location information and sends this information to the server.
[0234] Server: Based on the received location information, it searches the database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[0235] Notification of information about evacuation shelters
[0236] Server: Notifies the user's device of information regarding recommended evacuation locations (e.g., name, address, distance, and route from the current location of the evacuation center). This notification also includes detailed map information to the evacuation center, allowing the user to head to the evacuation center based on this information.
[0237] Generating a list of necessary supplies and managing the supplies provided.
[0238] Server: Matches the needs and inventory data of the evacuation area to create a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[0239] Tallying and arranging the delivery of donated supplies
[0240] Server: Aggregates information on the donated supplies and verifies whether all necessary supplies are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the delivery of the supplies. This ensures that necessary supplies reach evacuation areas quickly.
[0241] Support by an emotional engine
[0242] In addition to the evacuation order and supplies supply functions mentioned above, this system incorporates an emotion engine that recognizes the user's emotions, providing more personalized support.
[0243] Identifying emotions
[0244] Terminal: Acquires user voice and facial expression information and sends it to the emotion engine.
[0245] Emotion Engine: Analyzes acquired voice and facial expression information to identify the user's emotions (e.g., relief, anxiety, fear, etc.).
[0246] Customizing notification content
[0247] Server: Customizes shelter information notifications based on the emotions of identified users. For example, users with high stress levels will receive messages with more polite and calming language.
[0248] Specific example
[0249] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[0250] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[0251] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0252] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, and furthermore, by utilizing an emotion engine, it can provide personalized support to users.
[0253] The following describes the processing flow.
[0254] Processing related to evacuation orders
[0255] Step 1:
[0256] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0257] Step 2:
[0258] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[0259] Step 3:
[0260] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations will be used to obtain location information.
[0261] Step 4:
[0262] Terminal: Sends the acquired current location information to the server.
[0263] Step 5:
[0264] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. Factors such as safety, capacity, and current congestion are considered when selecting an evacuation shelter.
[0265] Step 6:
[0266] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[0267] Step 7:
[0268] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[0269] Step 8:
[0270] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[0271] Step 9:
[0272] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[0273] Processing of requests for necessary supplies
[0274] Step 1:
[0275] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[0276] Step 2:
[0277] Server: Verify the user's authentication information and grant permission to log in.
[0278] Step 3:
[0279] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[0280] Step 4:
[0281] Server: Present the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[0282] Step 5:
[0283] User: Select available supplies (e.g., 10 liters of drinking water, 5 blankets) and input the information.
[0284] Step 6:
[0285] Terminal: Transmit the input supply information to the server.
[0286] Step 7:
[0287] Server: Aggregate the provided supply information and check if the necessary supplies are sufficient. Furthermore, formulate an optimal delivery plan based on the provided supplies.
[0288] Step 8:
[0289] Server: Calculate the optimal delivery route and method and arrange for the delivery of supplies. This process includes cooperation with logistics providers and setting delivery priorities.
[0290] Step 9:
[0291] Server: Notify the supply provider that the delivery arrangement has been completed. This notification includes the scheduled delivery date and time and tracking information.
[0292] Support by the emotion engine
[0293] Processing related to emotion recognition
[0294] Step 1:
[0295] Terminal: Collect the user's voice information with a microphone and capture the facial expression with a camera.
[0296] Step 2:
[0297] Terminal: Transmit the collected voice information and facial expression information to the emotion engine.
[0298] Step 3:
[0299] Emotion engine: Analyze the voice information and facial expression information to identify the user's emotion (e.g., comfort, uneasiness, fear, etc.).
[0300] Step 4:
[0301] Emotion engine: Transmit the identified emotion information to the server.
[0302] Processing related to emotion-based notification customization
[0303] Step 1:
[0304] Server: Receive the identified user's emotion information.
[0305] Step 2:
[0306] Server: Customize the notification content of the evacuation shelter information based on the user's emotion. For example, generate a more detailed and reassuring message for users with a high stress level.
[0307] Step 3:
[0308] Server: Transmit the customized notification content to the user's terminal. Transmit an additional message such as "Please feel at ease. There is enough space and supplies in the evacuation shelter."
[0309] As a concrete example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[0310] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[0311] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0312] Thus, this invention provides rapid evacuation support and provision of necessary supplies during earthquakes, and further enables personalized support to users by utilizing an emotion engine.
[0313] (Example 2)
[0314] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0315] During an earthquake, extremely rapid and accurate evacuation support is required. However, conventional systems have the problem of providing general and uniform evacuation information, which does not adequately consider the individual circumstances and emotional states of users. Furthermore, while rapid supply of goods is essential, conventional systems sometimes made it difficult to carry out this smoothly. To solve these problems, a system is needed that allows for more detailed responses in evacuation support and supply of goods.
[0316] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0317] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotion information. This enables rapid and accurate evacuation support while taking into account the emotional state of each individual user. It also enables the smooth and rapid provision of supplies necessary for evacuation support.
[0318] "Earthquake information" refers to detailed information about the occurrence of an earthquake, specifically including data such as the time of occurrence, epicenter, and seismic intensity.
[0319] "Means of real-time collection" refers to technological means for instantly acquiring earthquake information via the internet and storing it in a database.
[0320] "User's current location information" refers to the specific latitude and longitude information of the user's current location.
[0321] "Means for obtaining current location information" refers to technical means that use GPS functionality to obtain the user's current location.
[0322] "Methods for searching for evacuation shelters" refers to technical means that identify the most appropriate evacuation location based on the user's current location from a database.
[0323] "Information regarding evacuation shelters" refers to detailed data about evacuation shelters, such as their names, addresses, distances, and map information.
[0324] "Means of notification" refers to technical means of transmitting relevant information to users via smartphones or other communication devices.
[0325] "Means of recognizing emotions" refers to technological means for analyzing and identifying a user's emotional state from their voice and facial expressions.
[0326] "Emotional information" refers to data that indicates the user's emotional state (e.g., feeling safe, anxious, fearful, etc.).
[0327] "Means for customizing notification content" refers to technical means that adjust the content of messages and notifications sent based on the user's emotional information.
[0328] "Supplies" refers to basic necessities of life such as drinking water, food, and blankets that are needed in evacuation shelters.
[0329] A "list of necessary supplies" refers to a list of items that are in short supply in the evacuation area.
[0330] "Supplies that can be provided" refers to supplies that can be supplied by users outside the affected area.
[0331] "Information on the provision of supplies" refers to detailed data about the supplies that can be provided (e.g., type, quantity).
[0332] "Means for aggregating and arranging delivery" refers to technical means that aggregate the provided material information, calculate the optimal delivery route, and execute the delivery procedures for the materials.
[0333] This invention is a system aimed at rapid evacuation guidance and supply of necessary goods during an earthquake, and further provides more personalized support by recognizing the user's emotions. This system consists of the interaction of a server, terminals, and users.
[0334] Collection of earthquake information
[0335] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency (JMA). Using the JMA's API, it retrieves earthquake information such as the time of occurrence, epicenter, and seismic intensity, and stores this information in a database (e.g., MySQL). The server periodically executes scripts to retrieve data from the sources and update the database.
[0336] Acquiring user location information and searching for evacuation shelters
[0337] Users launch a smartphone app when an earthquake occurs to request evacuation information.
[0338] The device uses GPS functionality to obtain its current location. The acquired location information is configured to be sent to a server.
[0339] The server searches the database for the nearest evacuation shelter based on the received location information. Specifically, it uses an SQL SELECT statement to compare the user's location information with evacuation shelter data to identify the most suitable shelter.
[0340] Notification of information about evacuation shelters
[0341] The server generates information about recommended evacuation locations and notifies the user's device. Specifically, it creates a notification that includes the name, address, distance, and map information of the evacuation center, and sends it as a push notification via a smartphone app.
[0342] Generating a list of necessary supplies and managing the supplies provided.
[0343] The server matches the needs of the evacuation area with inventory data and generates a list of necessary supplies. The generated list is then presented to users outside the affected area who are connected to the system.
[0344] Users select the supplies they can provide and send that information to the server. The server stores and aggregates this information in a database.
[0345] Tallying and arranging the delivery of donated supplies
[0346] The server aggregates information on supplies submitted by users and verifies whether all necessary supplies are available. Based on the aggregated results, it calculates the optimal delivery route and arranges for the supplies to be delivered. Delivery arrangements are automated using the delivery company's API.
[0347] Support by an emotional engine
[0348] The device uses its camera and microphone to acquire the user's voice and facial expression information. The acquired information is then sent to the emotion engine.
[0349] The emotion engine analyzes acquired audio and facial expression information to identify the user's emotions. Machine learning models (e.g., TensorFlow, OpenCV) are used for emotion identification.
[0350] The server customizes evacuation notifications based on identified emotional information. For example, it sends a reassuring message to users who are feeling stressed.
[0351] Specific example
[0352] If an earthquake occurs in Tokyo and user A is in Chiyoda Ward, user A will launch a smartphone app after the earthquake to request evacuation information. The device will use GPS to obtain its current location and send this information to the server. The server will identify "Chiyoda Park" as the best evacuation shelter and send a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[0353] Furthermore, the device uses its camera to identify user A's face and its microphone to collect audio. The emotion engine analyzes this information and identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[0354] Simultaneously, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation zone. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and, once the necessary supplies are gathered, calculates the optimal delivery route and arranges for delivery.
[0355] In this way, the present invention can provide users with rapid and accurate evacuation guidance and the prompt supply of necessary materials. Furthermore, by utilizing an emotion engine, it is possible to provide personalized support tailored to the individual circumstances of each user.
[0356] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0357] Step 1: Gathering earthquake information
[0358] The server collects earthquake information in real time from sources such as the Japan Meteorological Agency. First, the server sends a request to the Japan Meteorological Agency's API and retrieves earthquake information returned in JSON format. This includes the time of occurrence, epicenter, and seismic intensity. The server then analyzes this data and stores it in the database using INSERT statements.
[0359] Input: Earthquake information from the Japan Meteorological Agency API
[0360] Output: Earthquake information stored in the database
[0361] Step 2: Obtain the user's current location information
[0362] When an earthquake occurs, the user launches a smartphone app to request evacuation information. The app uses the smartphone's GPS function to obtain the user's current location. The app then sends the obtained latitude and longitude information to the server's API as a POST request.
[0363] Input: Latitude and longitude information obtained via GPS
[0364] Output: Current location information sent to the server
[0365] Step 3: Search for an evacuation shelter
[0366] The server searches the database for the nearest shelter based on the received location information. First, it executes an SQL query that compares the received latitude and longitude information with the shelter data and calculates the distance. It identifies the shelter with the shortest distance and returns that information as a response.
[0367] Input: User's current location information, evacuation shelter database
[0368] Output: Information on the best evacuation shelters
[0369] Step 4: Notification of evacuation shelter information
[0370] The server generates information about recommended evacuation shelters (e.g., shelter name, address, distance, map information). This information is sent to the app as a push notification. The notification is configured to include a link to the evacuation shelter and route guidance.
[0371] Input: Information on the best evacuation shelter
[0372] Output: Push notification to user's device
[0373] Step 5: Generate a list of necessary supplies and manage the supplies provided.
[0374] The server matches the needs of the evacuation area with inventory data to create a list of necessary supplies. It retrieves needs information from the database, matches it with inventory data, and generates a list of necessary supplies. This list is presented to users outside the affected area via the app. Users select the supplies they can provide and send that information to the server.
[0375] Input: Needs information for the evacuation area, inventory data
[0376] Output: List of required supplies, information on supplies provided by users
[0377] Step 6: Tallying and arranging delivery of donated supplies
[0378] The server aggregates information on the submitted supplies. It verifies that all necessary supplies are present and uses the delivery company's API to calculate the optimal delivery route. It generates delivery labels and route information to arrange for quick delivery.
[0379] Input: Information on supplies provided by the user, delivery company API
[0380] Output: Aggregated material data, delivery labels, and route information
[0381] Step 7: User emotion recognition
[0382] The device uses its camera and microphone to capture the user's face and voice. This information is sent to an emotion engine, which performs analysis to identify the user's emotional state. Specifically, TensorFlow and OpenCV are used. The results of this analysis are then sent to a server.
[0383] Input: User's face and voice data
[0384] Output: Identified sentiment information
[0385] Step 8: Customize notification content based on emotional information
[0386] The server customizes notification content based on identified emotional information. For example, it generates and sends a more reassuring message to a user who is feeling anxious. The customized message is then sent to the user's device as a push notification.
[0387] Input: Identified sentiment information
[0388] Output: Customized notification content
[0389] (Application Example 2)
[0390] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0391] Conventional earthquake evacuation guidance systems lack sufficient capabilities to quickly and efficiently guide evacuees to safety. Furthermore, they often provide generic evacuation instructions without considering the emotional needs of evacuees, resulting in unresolved psychological burdens. Additionally, the supply of necessary goods to evacuation centers is often insufficient, leading to poor living conditions. To address these issues, real-time information gathering and evacuation guidance, along with notifications that consider the emotions of evacuees and the rapid supply of necessary goods, are essential.
[0392] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotions. As a result, the user can acquire earthquake information in real time, move to the nearest evacuation shelter quickly and efficiently, and receive personalized messages to reduce psychological burden and realize a safe and secure evacuation. In addition, since the delivery of supplies using autonomous vehicles is also arranged, it becomes possible to supply necessary supplies to evacuation shelters quickly and efficiently.
[0393] "Means for collecting earthquake information in real time" refers to a device or system that acquires various earthquake-related data (such as the time of occurrence, epicenter, and seismic intensity) from reliable sources in real time when an earthquake occurs and stores it in a database.
[0394] "Means for obtaining the user's current location information" refers to a device or system that accurately obtains the user's current location using GPS functionality or other location information technologies.
[0395] "Means for searching for evacuation shelters" refers to a device or system that searches for the nearest evacuation shelter based on acquired location information and identifies the most suitable evacuation location for the user.
[0396] "Means of notifying users of information regarding evacuation shelters" refers to a device or system that notifies users' terminals of detailed information such as the name, address, distance, and route from their current location to a designated evacuation shelter.
[0397] "Means of recognizing user emotions" refers to devices or systems that use sensors such as cameras and microphones to analyze a user's emotions (e.g., reassurance, anxiety, fear, etc.) from their facial expressions and voice.
[0398] "Means of customizing notification content based on emotions" refers to a device or system that personalizes the content of evacuation shelter information notifications and generates appropriate messages according to the recognized emotions of the user.
[0399] "Means for generating a list of necessary supplies" refers to a device or system that matches the needs of the evacuation area with inventory data to create a list of required supplies.
[0400] "Means for selecting available supplies" refers to a device or system that allows users connected to the system to select available supplies and transmit that information to the server.
[0401] "Means for aggregating information on the provision of goods and arranging delivery" refers to a device or system that aggregates information on the provided goods, calculates the optimal delivery route, and arranges for the delivery of the goods.
[0402] "Means of delivering supplies using autonomous vehicles" refers to a device or system that uses autonomous vehicles to efficiently and quickly deliver necessary supplies to evacuation centers.
[0403] One embodiment of this invention is an evacuation guidance and supplies supply system using autonomous vehicles. This system collects earthquake information in real time, obtains the user's current location, searches for the optimal evacuation shelter, performs sentiment analysis, and then provides customized evacuation information. It also provides rapid supplies using autonomous vehicles.
[0404] Hardware configuration
[0405] Server: Manages earthquake information and supply data, and notifies users.
[0406] Device: Includes smartphones and tablets, cameras, microphones, and GPS modules, and acquires the user's location information and emotional information.
[0407] Autonomous vehicles: Used for transporting evacuees and delivering supplies.
[0408] Software Configuration
[0409] Earthquake Information Acquisition System: Collects data from the Japan Meteorological Agency and other sources in real time.
[0410] Location information acquisition system: Acquires GPS data to determine the user's current location.
[0411] Evacuation shelter search system: Identifies the nearest evacuation shelter from the database.
[0412] Notification system: Notifies users of evacuation shelter information.
[0413] Emotion recognition engine: Recognizes emotions from data acquired from cameras and microphones using tools such as TensorFlow.
[0414] Notification customization system: Customizes notification content based on sentiment analysis results.
[0415] Supplies Management System: Generates a list of necessary supplies, compiles the available supplies, and arranges for their delivery.
[0416] Automated vehicle control system: Used for transporting supplies and evacuees.
[0417] Specific example of processing procedure
[0418] 1. In the event of an earthquake, the server will collect earthquake information from the Japan Meteorological Agency and other sources and immediately store it in the database.
[0419] 2. The user launches the smartphone app and obtains their current location information using the GPS function. This information is sent to the server by the device.
[0420] 3. The server searches the database for the nearest evacuation shelter based on the user's current location. It generates information about the evacuation shelter (e.g., shelter name, address, distance, route from the current location) and sends it to the terminal.
[0421] 4. The device uses its camera and microphone to capture the user's face and voice, and sends this data to the server's emotion recognition engine.
[0422] 5. The emotion recognition engine uses TensorFlow to analyze emotions and sends the results to the notification customization system.
[0423] 6. Based on the sentiment analysis results, the server customizes and notifies users of personalized evacuation information.
[0424] 7. The server matches the needs of the evacuation area with inventory data and generates a list of necessary supplies. Users select the supplies they can provide and send that information to the server.
[0425] 8. The server aggregates information on the supplies to be provided, calculates the optimal delivery route, and arranges for the delivery of the supplies. Autonomous vehicles are used to deliver the supplies quickly.
[0426] Example (In the event of an earthquake in Tokyo)
[0427] If a user is in Chiyoda Ward, Tokyo, they launch a smartphone app. The device uses GPS to obtain its current location and sends it to the server. The server notifies the user that the nearest evacuation shelter is "Chiyoda Park." Furthermore, the camera identifies the user's face and the microphone collects their voice. Based on this, the emotion engine identifies the user as "anxious," and the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter." Simultaneously, users in other areas check the list of necessary supplies and send information about available supplies to the server. The server compiles the supply information and uses autonomous vehicles to quickly deliver the supplies to the shelter.
[0428] Example of a prompt
[0429] Obtain the user's current location (latitude: 35.6895, longitude: 139.6917) and search for the nearest shelter. Also, identify the user's emotions and generate an appropriate message. The user's face image is "user_image.jpg" and their voice data is "user_voice.wav".
[0430] In this way, the entire system works together, enabling swift and efficient support for evacuees.
[0431] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0432] Step 1:
[0433] The server collects earthquake information from reliable sources (e.g., the Japan Meteorological Agency) when an earthquake occurs. The collected data includes the time of the earthquake, the epicenter, and the seismic intensity. This information is acquired in real time and stored in a database. This allows for the rapid acquisition of detailed earthquake information.
[0434] Step 2:
[0435] After an earthquake, the user launches a smartphone app to request evacuation information. At this time, the device uses its GPS function to obtain the user's current location. This location information is then sent to a server. The input requires the current location (latitude and longitude), and this location information is sent to the server as output.
[0436] Step 3:
[0437] The server searches the database for the nearest evacuation shelter based on the received current location information. It matches the location information with the evacuation shelter data to generate information about the nearest shelter. This information includes details such as the shelter's name, address, distance, and directions from the current location. This information is then output to the next step.
[0438] Step 4:
[0439] The server notifies the user's terminal of the generated evacuation shelter information. This notification also includes detailed map information to the evacuation shelter. This allows the user to confirm the optimal evacuation route. The input requires evacuation shelter information and the user's terminal information, and the output is a notification sent.
[0440] Step 5:
[0441] The device identifies the user's face with a camera and collects audio with a microphone. The acquired facial image and audio data are sent to the server's emotion recognition engine. This emotion recognition engine analyzes the user's emotions using a generative AI model. The input requires facial image and audio data, and the output is the recognized emotion (e.g., reassurance, anxiety, fear).
[0442] Step 6:
[0443] The server receives results from the emotion recognition engine and customizes the notification content based on the identified emotion. For example, if the user is feeling anxious, it will generate a message such as, "Don't worry. There is plenty of space and supplies at the shelter." Emotional information is required as input, and a customized message is generated as output.
[0444] Step 7:
[0445] The server matches the needs and inventory data of the evacuation area and generates a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server. Needs data and inventory data are required as input, and the necessary supplies list is generated as output.
[0446] Step 8:
[0447] The server aggregates information on the donated supplies and verifies whether all necessary supplies are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the delivery of supplies using autonomous vehicles. This enables the necessary supplies to reach evacuation areas quickly. The input requires information on the donated supplies, and the output provides the delivery route.
[0448] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0449] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0450] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0451] [Second Embodiment]
[0452] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0453] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0454] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0455] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0456] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0457] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0458] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0459] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0460] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0461] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0462] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0463] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0464] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake. This system consists of the interaction of a server, terminals, and users.
[0465] Program Overview
[0466] The following programs are executed on this system:
[0467] Collection of earthquake information
[0468] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0469] Acquiring user location information and searching for evacuation shelters
[0470] When an earthquake occurs, the user launches a smartphone app. The device uses its GPS function to obtain its current location and sends this information to the server. Based on the received location information, the server searches its database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[0471] Notification of information about evacuation shelters
[0472] The server notifies the user's device of information regarding recommended evacuation locations (e.g., the name of the evacuation center, its address, and its distance from the user's current location). This notification also includes detailed map information to the evacuation center, allowing the user to head to the location based on this information.
[0473] Generating a list of necessary supplies and managing the supplies provided.
[0474] The server matches the needs of the evacuation area with inventory data and creates a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[0475] Tallying and arranging the delivery of donated supplies
[0476] The server aggregates information on the donated supplies and verifies whether all necessary items are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the supplies to be delivered. This ensures that necessary supplies reach evacuation areas quickly.
[0477] Specific example
[0478] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." User A clicks the provided link and evacuates while checking map information to the shelter.
[0479] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0480] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, ensuring that users can obtain appropriate evacuation information and that necessary supplies are supplied quickly.
[0481] The following describes the processing flow.
[0482] Specific processing of the program
[0483] Processing related to evacuation orders
[0484] Step 1:
[0485] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0486] Step 2:
[0487] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[0488] Step 3:
[0489] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations are used.
[0490] Step 4:
[0491] Terminal: Sends the acquired current location information to the server.
[0492] Step 5:
[0493] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. When selecting an evacuation shelter, it considers the shelter's capacity and current congestion level.
[0494] Step 6:
[0495] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[0496] Step 7:
[0497] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[0498] Step 8:
[0499] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[0500] Step 9:
[0501] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[0502] Processing of requests for necessary supplies
[0503] Step 1:
[0504] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[0505] Step 2:
[0506] Server: Verify the user's authentication information and grant permission to log in.
[0507] Step 3:
[0508] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[0509] Step 4:
[0510] Server: Presents the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[0511] Step 5:
[0512] User: Select the supplies you can provide (e.g., 10 liters of drinking water, 5 blankets) and enter the information.
[0513] Step 6:
[0514] Terminal: Sends the entered supply provision information to the server.
[0515] Step 7:
[0516] Server: Aggregates the provided supply information and verifies that sufficient supplies are available. Furthermore, it develops the optimal delivery plan based on the provided supplies.
[0517] Step 8:
[0518] Server: Calculates the optimal delivery route and method, and arranges the delivery of goods. This process includes coordinating with logistics providers and setting delivery priorities.
[0519] Step 9:
[0520] Server: Notifies the supply provider that delivery arrangements are complete. This notification includes the scheduled delivery date and time and tracking information.
[0521] In this way, this system enables rapid evacuation support and efficient supply of necessary goods during earthquakes.
[0522] (Example 1)
[0523] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0524] When an earthquake strikes, it is crucial to quickly and accurately gather information and provide appropriate evacuation guidance to users. Furthermore, effectively supplying necessary goods to evacuation areas is also a critical issue. However, conventional systems struggled to handle such a comprehensive response, sometimes resulting in delays in information and shortages of supplies. This made it difficult to ensure the safety of evacuees and provide rapid assistance.
[0525] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0526] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation sites based on the current location information, means for notifying the user's terminal of information regarding the evacuation sites, means for matching demand and inventory data of the evacuation area and generating a list of necessary supplies, means for allowing the user to select available supplies, and means for aggregating supply provision information and arranging delivery. This enables rapid and accurate evacuation guidance and supply of goods in the event of an earthquake.
[0527] "Earthquake information" refers to data that includes information such as the time of the earthquake, the epicenter, and the seismic intensity.
[0528] "Methods for collecting data in real time" refers to methods for instantly acquiring earthquake information and storing it in a database.
[0529] A "user" refers to an individual or group that uses the system.
[0530] "Current location information" refers to data that includes the latitude and longitude of the user's current location.
[0531] "Means of obtaining current location information" refers to methods of obtaining a user's current location information using technologies such as GPS.
[0532] A "shelter" refers to a place where people can ensure their safety during an earthquake, such as a shelter or temporary evacuation site.
[0533] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[0534] "Information regarding evacuation shelters" refers to detailed information such as the name of the evacuation shelter, its address, distance from your current location, and its capacity.
[0535] "Means for notifying users of evacuation shelters on their devices" refers to means for transmitting information about evacuation shelters to users' devices.
[0536] An "evacuation zone" is an area affected by an earthquake where evacuation is necessary.
[0537] "Demand" refers to the amount of goods and services needed in an evacuation zone.
[0538] "Inventory data" refers to information about the stock of goods and services that can be supplied.
[0539] A "list of necessary supplies" is a list that shows a list of supplies needed in an evacuation area.
[0540] "Means of allowing users to select available supplies" refers to methods of allowing users to select the supplies they can provide and transmitting that information to the system.
[0541] "Information on the provision of goods" refers to detailed information (type, quantity, etc.) about the goods provided by users.
[0542] "Means for aggregating information on the provision of supplies and arranging delivery" refers to means for efficiently delivering necessary supplies based on the aggregated information on the provision of supplies.
[0543] "Map information" refers to geographical guidance information necessary for users to find their way to an evacuation site.
[0544] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake, and consists of the interaction of a server, terminals, and users. This system makes it possible to collect earthquake information in real time, provide appropriate evacuation information to users, and rapidly supply necessary goods.
[0545] Collection of earthquake information
[0546] The server collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency. This process involves sending HTTP requests and parsing the JSON data received as responses. Specific data includes the time of the earthquake, its epicenter, and its seismic intensity. The collected data is stored in a MySQL database.
[0547] Obtaining user location information
[0548] When an earthquake occurs, the user launches a dedicated smartphone app. The device (smartphone) obtains GPS data through location services. The obtained location data (latitude and longitude) is sent to a server via Firebase and stored in a database.
[0549] Search for evacuation shelters
[0550] The server searches its database for the nearest evacuation shelter based on the user's current location information. This process uses PostGIS to calculate geographical distances. From the calculation results, it retrieves detailed information such as the name, address, latitude, and longitude of the nearest evacuation shelter.
[0551] Notification of evacuation shelter information
[0552] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. This notification includes the name and address of the evacuation shelter, as well as map information including a Google Maps link. In this way, the user can confirm the route to the appropriate evacuation shelter.
[0553] Generating a list of necessary supplies
[0554] The server matches demand and inventory data for the evacuation area and generates a list of necessary supplies. Based on inventory data retrieved from the database, it creates a list of supplies needed in the evacuation area (e.g., drinking water, blankets, emergency food, etc.) and displays it on the system's web interface.
[0555] Management and tabulation of donated goods
[0556] Users (who are outside the evacuation zone) log in and select the supplies they can provide. The selected supply information is sent to the server and stored in the database. The server aggregates the supply information provided by each user and checks whether the necessary supplies have been collected.
[0557] Delivery arrangements
[0558] The server calculates the optimal delivery route based on the aggregated supply information. Based on the calculated delivery route, it arranges for the delivery of supplies through the APIs of partner logistics companies. Finally, it notifies the supply providers and the evacuation areas of the delivery status of the supplies.
[0559] Specific example
[0560] For example, suppose an earthquake occurs in Tokyo, and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app and requests evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that a "park" evacuation shelter in Chiyoda Ward is the most suitable evacuation location and notifies user A of this information. User A clicks on the map link and evacuates while checking the route to the evacuation shelter.
[0561] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0562] Example of a prompt
[0563] "An earthquake has occurred, and users need evacuation information. Please design a system that notifies users of the optimal evacuation location and route. Additionally, please add a mechanism to provide users outside the evacuation zone with information on necessary supplies and to arrange for their delivery."
[0564] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0565] Step 1:
[0566] The server collects earthquake information in real time. Specifically, it sends HTTP requests to APIs of information sources such as the Japan Meteorological Agency. The input includes the API endpoint URL and request parameters, and the output is earthquake information in JSON format. This received data contains information about the time of the earthquake, the epicenter, and the seismic intensity, which is parsed and stored in a MySQL database.
[0567] Step 2:
[0568] When an earthquake occurs, the user launches a smartphone app. The device (smartphone) obtains GPS data using location services. The input includes raw data from the GPS sensor, and the output is the latitude and longitude of the current location. This location information is sent to the server via Firebase. The server receives this data and stores it in a database.
[0569] Step 3:
[0570] The server searches for the nearest evacuation shelter from its database based on the user's current location information. Specifically, it uses PostGIS to calculate geographical distances based on the received latitude and longitude. The input includes the user's location information and database information on evacuation shelters, and the output provides the name, address, latitude, and longitude of the optimal evacuation shelter.
[0571] Step 4:
[0572] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. The input includes detailed information about the evacuation shelter (name, address, map link), and the output is a push notification of the evacuation shelter information sent to the user's smartphone. The notification also includes a detailed map link of the evacuation shelter, which the user can click to view the map information.
[0573] Step 5:
[0574] The server retrieves demand and inventory data for the evacuation area from a database and generates a list of necessary supplies. The input includes demand and inventory data for the evacuation area, and the output is a list of necessary supplies (e.g., drinking water, blankets, emergency food, etc.). This list is presented through the system's web interface.
[0575] Step 6:
[0576] Users (who are outside the evacuation zone) log in and select the supplies they can provide. Specifically, they enter details of the supplies they can provide via a web interface and submit them. The input includes the username, the type and quantity of supplies to be provided, and the information about the supplies provided is sent to the server and stored in the database.
[0577] Step 7:
[0578] The server checks whether all necessary supplies are available based on the aggregated supply information. Input includes supply information and required supply lists provided by each user, and output provides the total amount of supplies and a list of missing supplies. Based on this, the server calculates the optimal delivery route.
[0579] Step 8:
[0580] The server calculates the optimal delivery route and then arranges for the delivery of supplies through the API of a partner logistics company. Inputs include the delivery address, detailed information about the supplies, and optimal route information, and the output is the completion of the supply delivery arrangement. The delivery status is also monitored, and notifications are sent to the supply provider and the evacuation area.
[0581] (Application Example 1)
[0582] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0583] During an earthquake, rapid and accurate evacuation guidance is crucial. However, conventional systems are insufficient for real-time earthquake information gathering, user location acquisition, and shelter search and notification, often leading to delays in evacuation. Furthermore, the supply of necessary goods in evacuation areas may be delayed, posing a challenge in responding quickly to the needs of evacuees. In particular, rapid response is extremely important in the event of a large-scale earthquake, but conventional methods struggle to adequately achieve this.
[0584] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0585] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for generating a list of necessary supplies based on the needs of the evacuation area using a generative model, means for notifying the user of the generated evacuation shelter and necessary supplies information, and means for generating prompt sentences for input into the generative AI model. This enables rapid and accurate evacuation guidance and the rapid supply of supplies to meet the needs of the evacuation area in the event of an earthquake.
[0586] "Earthquake information" refers to information that includes data such as the time of the earthquake, the epicenter, and the seismic intensity.
[0587] "Real-time collection" means collecting information almost immediately after an earthquake occurs.
[0588] "User's current location information" refers to information about the user's current location, identified using means such as GPS.
[0589] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[0590] "Information regarding evacuation shelters" includes information such as the name of the evacuation shelter, its address, and its distance from your current location.
[0591] A "generative model" is an algorithm that generates the desired output based on a given set of input data.
[0592] A "list of necessary supplies" is a list of essential items generated by matching the needs of the evacuation area with inventory data.
[0593] "Information on the provision of supplies" refers to data regarding the types and quantities of supplies that can be provided.
[0594] "Delivery arrangements" refer to the procedures for ensuring that supplies are delivered quickly to designated evacuation areas.
[0595] A "generative AI model" is an artificial intelligence system designed to perform specific tasks or process data using machine learning techniques.
[0596] A "prompt statement" is an input statement to a generative AI model, in the form of instructions or questions to obtain the required output.
[0597] A system for carrying out this invention includes the following configuration.
[0598] System configuration and hardware / software used
[0599] 1. Servers: Cloud services such as AWS and Google Cloud will be used for real-time data processing and database management. MySQL and PostgreSQL will be used as databases to store earthquake information, evacuation center information, and information on the provision of supplies.
[0600] 2. Earthquake Information Collection API: Using APIs from the Japan Meteorological Agency and other sources, data such as the time of earthquake occurrence, epicenter, and seismic intensity are obtained in real time.
[0601] 3. Smartphone device: Uses an iOS or Android smartphone and obtains the user's current location information using GPS functionality. Data communication with the server is performed via internet connection and notification services.
[0602] 4. Generative AI Model: Using machine learning techniques, this model generates lists of necessary supplies based on the needs of evacuation areas and generates prompt messages. The model is built and operated using libraries such as TensorFlow and PyTorch.
[0603] Processing flow
[0604] 1. Gathering earthquake information:
[0605] The server uses an earthquake information API to acquire earthquake data in real time and stores it in a database.
[0606] 2. Obtaining the user's location information:
[0607] Smartphones use GPS functionality to obtain the user's current location and send it to a server. This location information is used to search for evacuation shelters.
[0608] 3. Searching for and notifying evacuation shelters:
[0609] The server searches its database for the nearest evacuation shelter based on the user's current location. The server then notifies the user's smartphone of the shelter's information. The notification includes the shelter's name, address, distance from the user's current location, and route information.
[0610] 4. Generating a list of necessary supplies:
[0611] The server uses a generative AI model to match the needs of the evacuation area with inventory data and generate a list of necessary supplies. This list is provided to users in other regions and serves as a basis for selecting relief supplies.
[0612] 5. Management of supply information and arrangement of delivery:
[0613] The provided supply information is compiled on a server, the optimal delivery route is calculated, and arrangements are made with logistics companies. This ensures that supplies are delivered quickly.
[0614] Specific example
[0615] For example, if an earthquake occurs in Tokyo, the system will operate as follows:
[0616] (Example of a prompt message)
[0617] During an earthquake:
[0618] User's current location: Chiyoda-ku, Tokyo
[0619] Shelter search criteria: The shelter closest to the user.
[0620] Notification content: Detailed route information to the nearest evacuation shelter and evacuation destination.
[0621] Based on this prompt, the server retrieves information about the nearest evacuation shelter, "Chiyoda Park," and notifies the user. The notification includes the message, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." The user can click the provided link and evacuate while viewing map information to the shelter.
[0622] At the same time, users outside the evacuation zone are presented with a list of necessary supplies and can select the items they can provide and send them to the server. Based on this information, the server compiles the supplies, arranges for their delivery, and delivers them to the evacuation centers via the most optimal route.
[0623] In this way, this system enables rapid evacuation guidance and the supply of necessary goods to evacuation areas during earthquakes.
[0624] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0625] Step 1: Gathering earthquake information
[0626] The server calls the Japan Meteorological Agency's earthquake information API to obtain real-time data such as the time of earthquake occurrence, epicenter, and seismic intensity. The obtained data is stored in a MySQL or PostgreSQL database. The input is earthquake data obtained from the earthquake information API, and the output is earthquake information stored in the database.
[0627] Step 2: Obtaining the user's location information
[0628] The device (the user's smartphone) obtains its current location information using the built-in GPS function. The obtained location information is transmitted to the server via the internet. The input is the user's current location information obtained from GPS, and the output is the location information data transmitted to the server.
[0629] Step 3: Search for an evacuation shelter
[0630] The server uses the user's current location information to search the database for the nearest evacuation shelter. This uses an algorithm that calculates distance using the location information to identify the closest shelter. The input is the user's current location information, and the output is the nearest evacuation shelter information.
[0631] Step 4: Notification of evacuation shelter information
[0632] When the server retrieves information about the nearest evacuation shelter, it sends a notification to the user's device. The notification includes the name and address of the shelter, the distance from the current location, and detailed route information. Specifically, the server sends a push notification to the device. The input is the information about the nearest evacuation shelter, and the output is the notification message sent to the user.
[0633] Step 5: Generate a list of necessary supplies
[0634] The server uses a generative AI model to generate a list of necessary supplies based on the needs and inventory data of the evacuation area. Specifically, it optimizes the supply of goods to meet the estimated needs of the evacuation area. The input is the needs data and inventory data of the evacuation area, and the output is a list of necessary supplies.
[0635] Step 6: Choosing the Provision of Supplies
[0636] Users outside the evacuation zone log into the system using a terminal and select the supplies they can provide based on the list of necessary supplies provided by the server. The selection information is sent to the server. The input is the information of the supplies selected by the user, and the output is the information of the supplies provided that is sent to the server.
[0637] Step 7: Compiling information on supply provision and arranging delivery.
[0638] The server uses the collected supply information to verify that all necessary supplies are available and calculates the optimal delivery route. It then calls the logistics provider API to arrange the actual delivery. The input is the aggregated supply information, and the output is the delivery arrangement information sent to the logistics provider.
[0639] Step 8: Notification of the list of necessary supplies and shelter information.
[0640] The server generates prompt statements for input to the AI model, uses them to generate notification messages containing information on each evacuation center and necessary supplies, and sends them to personnel and support staff in the evacuation area. For example, a prompt statement like "When an earthquake occurs: User's current location: Chiyoda-ku, Tokyo; Evacuation center search criteria: Evacuation center closest to the user; Notification content: Detailed route information to the nearest evacuation center and evacuation destination" is used. The input is the prompt statement, and the output is the generated notification message.
[0641] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0642] This invention provides more personalized support by combining a system designed for rapid evacuation guidance and supply of necessary goods during an earthquake with an emotion engine that recognizes the user's emotions. This system consists of the interaction of a server, a terminal, and the user.
[0643] Program Overview
[0644] The following programs are executed on this system:
[0645] Collection of earthquake information
[0646] Server: Collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency, and stores various earthquake-related data (occurrence time, epicenter, seismic intensity, etc.) in a database.
[0647] Acquiring user location information and searching for evacuation shelters
[0648] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[0649] Device: Uses GPS functionality to obtain current location information and sends this information to the server.
[0650] Server: Based on the received location information, it searches the database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[0651] Notification of information about evacuation shelters
[0652] Server: Notifies the user's device of information regarding recommended evacuation locations (e.g., name, address, distance, and route from the current location of the evacuation center). This notification also includes detailed map information to the evacuation center, allowing the user to head to the evacuation center based on this information.
[0653] Generating a list of necessary supplies and managing the supplies provided.
[0654] Server: Matches the needs and inventory data of the evacuation area to create a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[0655] Tallying and arranging the delivery of donated supplies
[0656] Server: Aggregates information on the donated supplies and verifies whether all necessary supplies are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the delivery of the supplies. This ensures that necessary supplies reach evacuation areas quickly.
[0657] Support by an emotional engine
[0658] In addition to the evacuation order and supplies supply functions mentioned above, this system incorporates an emotion engine that recognizes the user's emotions, providing more personalized support.
[0659] Identifying emotions
[0660] Terminal: Acquires user voice and facial expression information and sends it to the emotion engine.
[0661] Emotion Engine: Analyzes acquired voice and facial expression information to identify the user's emotions (e.g., relief, anxiety, fear, etc.).
[0662] Customizing notification content
[0663] Server: Customizes shelter information notifications based on the emotions of identified users. For example, users with high stress levels will receive messages with more polite and calming language.
[0664] Specific example
[0665] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[0666] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[0667] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0668] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, and furthermore, by utilizing an emotion engine, it can provide personalized support to users.
[0669] The following describes the processing flow.
[0670] Processing related to evacuation orders
[0671] Step 1:
[0672] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0673] Step 2:
[0674] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[0675] Step 3:
[0676] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations will be used to obtain location information.
[0677] Step 4:
[0678] Terminal: Sends the acquired current location information to the server.
[0679] Step 5:
[0680] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. Factors such as safety, capacity, and current congestion are considered when selecting an evacuation shelter.
[0681] Step 6:
[0682] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[0683] Step 7:
[0684] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[0685] Step 8:
[0686] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[0687] Step 9:
[0688] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[0689] Processing of requests for necessary supplies
[0690] Step 1:
[0691] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[0692] Step 2:
[0693] Server: Verify the user's authentication information and grant permission to log in.
[0694] Step 3:
[0695] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[0696] Step 4:
[0697] Server: Presents the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[0698] Step 5:
[0699] User: Select the supplies you can provide (e.g., 10 liters of drinking water, 5 blankets) and enter the information.
[0700] Step 6:
[0701] Terminal: Sends the entered supply provision information to the server.
[0702] Step 7:
[0703] Server: Aggregates the provided supply information and verifies that sufficient supplies are available. Furthermore, it develops the optimal delivery plan based on the provided supplies.
[0704] Step 8:
[0705] Server: Calculates the optimal delivery route and method, and arranges the delivery of goods. This process includes coordinating with logistics providers and setting delivery priorities.
[0706] Step 9:
[0707] Server: Notifies the supply provider that delivery arrangements are complete. This notification includes the scheduled delivery date and time and tracking information.
[0708] Support by an emotional engine
[0709] Processing related to emotion recognition
[0710] Step 1:
[0711] Device: Collects user voice information via microphone and captures facial expressions with a camera.
[0712] Step 2:
[0713] Terminal: Sends collected voice and facial expression information to the emotion engine.
[0714] Step 3:
[0715] Emotion Engine: Analyzes voice and facial expression information to identify the user's emotions (e.g., relief, anxiety, fear, etc.).
[0716] Step 4:
[0717] Emotion engine: Sends identified emotion information to the server.
[0718] Processing related to emotion-based notification customization
[0719] Step 1:
[0720] Server: Receives sentiment information of identified users.
[0721] Step 2:
[0722] Server: Customizes the content of evacuation shelter information notifications based on the user's emotions. For example, it generates more polite and reassuring messages for users with high stress levels.
[0723] Step 3:
[0724] Server: Sends customized notification content to the user's device. It also sends an additional message: "Don't worry, there is plenty of space and supplies at the shelter."
[0725] As a concrete example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[0726] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[0727] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0728] Thus, this invention provides rapid evacuation support and provision of necessary supplies during earthquakes, and further enables personalized support to users by utilizing an emotion engine.
[0729] (Example 2)
[0730] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0731] During an earthquake, extremely rapid and accurate evacuation support is required. However, conventional systems have the problem of providing general and uniform evacuation information, which does not adequately consider the individual circumstances and emotional states of users. Furthermore, while rapid supply of goods is essential, conventional systems sometimes made it difficult to carry out this smoothly. To solve these problems, a system is needed that allows for more detailed responses in evacuation support and supply of goods.
[0732] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0733] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotion information. This enables rapid and accurate evacuation support while taking into account the emotional state of each individual user. It also enables the smooth and rapid provision of supplies necessary for evacuation support.
[0734] "Earthquake information" refers to detailed information about the occurrence of an earthquake, specifically including data such as the time of occurrence, epicenter, and seismic intensity.
[0735] "Means of real-time collection" refers to technological means for instantly acquiring earthquake information via the internet and storing it in a database.
[0736] "User's current location information" refers to the specific latitude and longitude information of the user's current location.
[0737] "Means for obtaining current location information" refers to technical means that use GPS functionality to obtain the user's current location.
[0738] "Methods for searching for evacuation shelters" refers to technical means that identify the most appropriate evacuation location based on the user's current location from a database.
[0739] "Information regarding evacuation shelters" refers to detailed data about evacuation shelters, such as their names, addresses, distances, and map information.
[0740] "Means of notification" refers to technical means of transmitting relevant information to users via smartphones or other communication devices.
[0741] "Means of recognizing emotions" refers to technological means for analyzing and identifying a user's emotional state from their voice and facial expressions.
[0742] "Emotional information" refers to data that indicates the user's emotional state (e.g., feeling safe, anxious, fearful, etc.).
[0743] "Means for customizing notification content" refers to technical means that adjust the content of messages and notifications sent based on the user's emotional information.
[0744] "Supplies" refers to basic necessities of life such as drinking water, food, and blankets that are needed in evacuation shelters.
[0745] A "list of necessary supplies" refers to a list of items that are in short supply in the evacuation area.
[0746] "Supplies that can be provided" refers to supplies that can be supplied by users outside the affected area.
[0747] "Information on the provision of supplies" refers to detailed data about the supplies that can be provided (e.g., type, quantity).
[0748] "Means for aggregating and arranging delivery" refers to technical means that aggregate the provided material information, calculate the optimal delivery route, and execute the delivery procedures for the materials.
[0749] This invention is a system aimed at rapid evacuation guidance and supply of necessary goods during an earthquake, and further provides more personalized support by recognizing the user's emotions. This system consists of the interaction of a server, terminals, and users.
[0750] Collection of earthquake information
[0751] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency (JMA). Using the JMA's API, it retrieves earthquake information such as the time of occurrence, epicenter, and seismic intensity, and stores this information in a database (e.g., MySQL). The server periodically executes scripts to retrieve data from the sources and update the database.
[0752] Acquiring user location information and searching for evacuation shelters
[0753] Users launch a smartphone app when an earthquake occurs to request evacuation information.
[0754] The device uses GPS functionality to obtain its current location. The acquired location information is configured to be sent to a server.
[0755] The server searches the database for the nearest evacuation shelter based on the received location information. Specifically, it uses an SQL SELECT statement to compare the user's location information with evacuation shelter data to identify the most suitable shelter.
[0756] Notification of information about evacuation shelters
[0757] The server generates information about recommended evacuation locations and notifies the user's device. Specifically, it creates a notification that includes the name, address, distance, and map information of the evacuation center, and sends it as a push notification via a smartphone app.
[0758] Generating a list of necessary supplies and managing the supplies provided.
[0759] The server matches the needs of the evacuation area with inventory data and generates a list of necessary supplies. The generated list is then presented to users outside the affected area who are connected to the system.
[0760] Users select the supplies they can provide and send that information to the server. The server stores and aggregates this information in a database.
[0761] Tallying and arranging the delivery of donated supplies
[0762] The server aggregates information on supplies submitted by users and verifies whether all necessary supplies are available. Based on the aggregated results, it calculates the optimal delivery route and arranges for the supplies to be delivered. Delivery arrangements are automated using the delivery company's API.
[0763] Support by an emotional engine
[0764] The device uses its camera and microphone to acquire the user's voice and facial expression information. The acquired information is then sent to the emotion engine.
[0765] The emotion engine analyzes acquired audio and facial expression information to identify the user's emotions. Machine learning models (e.g., TensorFlow, OpenCV) are used for emotion identification.
[0766] The server customizes evacuation notifications based on identified emotional information. For example, it sends a reassuring message to users who are feeling stressed.
[0767] Specific example
[0768] If an earthquake occurs in Tokyo and user A is in Chiyoda Ward, user A will launch a smartphone app after the earthquake to request evacuation information. The device will use GPS to obtain its current location and send this information to the server. The server will identify "Chiyoda Park" as the best evacuation shelter and send a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[0769] Furthermore, the device uses its camera to identify user A's face and its microphone to collect audio. The emotion engine analyzes this information and identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[0770] Simultaneously, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation zone. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and, once the necessary supplies are gathered, calculates the optimal delivery route and arranges for delivery.
[0771] In this way, the present invention can provide users with rapid and accurate evacuation guidance and the prompt supply of necessary materials. Furthermore, by utilizing an emotion engine, it is possible to provide personalized support tailored to the individual circumstances of each user.
[0772] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0773] Step 1: Gathering earthquake information
[0774] The server collects earthquake information in real time from sources such as the Japan Meteorological Agency. First, the server sends a request to the Japan Meteorological Agency's API and retrieves earthquake information returned in JSON format. This includes the time of occurrence, epicenter, and seismic intensity. The server then analyzes this data and stores it in the database using INSERT statements.
[0775] Input: Earthquake information from the Japan Meteorological Agency API
[0776] Output: Earthquake information stored in the database
[0777] Step 2: Obtain the user's current location information
[0778] When an earthquake occurs, the user launches a smartphone app to request evacuation information. The app uses the smartphone's GPS function to obtain the user's current location. The app then sends the obtained latitude and longitude information to the server's API as a POST request.
[0779] Input: Latitude and longitude information obtained via GPS
[0780] Output: Current location information sent to the server
[0781] Step 3: Search for an evacuation shelter
[0782] The server searches the database for the nearest shelter based on the received location information. First, it executes an SQL query that compares the received latitude and longitude information with the shelter data and calculates the distance. It identifies the shelter with the shortest distance and returns that information as a response.
[0783] Input: User's current location information, evacuation shelter database
[0784] Output: Information on the best evacuation shelters
[0785] Step 4: Notification of evacuation shelter information
[0786] The server generates information about recommended evacuation shelters (e.g., shelter name, address, distance, map information). This information is sent to the app as a push notification. The notification is configured to include a link to the evacuation shelter and route guidance.
[0787] Input: Information on the best evacuation shelter
[0788] Output: Push notification to user's device
[0789] Step 5: Generate a list of necessary supplies and manage the supplies provided.
[0790] The server matches the needs of the evacuation area with inventory data to create a list of necessary supplies. It retrieves needs information from the database, matches it with inventory data, and generates a list of necessary supplies. This list is presented to users outside the affected area via the app. Users select the supplies they can provide and send that information to the server.
[0791] Input: Needs information for the evacuation area, inventory data
[0792] Output: List of required supplies, information on supplies provided by users
[0793] Step 6: Tallying and arranging delivery of donated supplies
[0794] The server aggregates information on the submitted supplies. It verifies that all necessary supplies are present and uses the delivery company's API to calculate the optimal delivery route. It generates delivery labels and route information to arrange for quick delivery.
[0795] Input: Information on supplies provided by the user, delivery company API
[0796] Output: Aggregated material data, delivery labels, and route information
[0797] Step 7: User emotion recognition
[0798] The device uses its camera and microphone to capture the user's face and voice. This information is sent to an emotion engine, which performs analysis to identify the user's emotional state. Specifically, TensorFlow and OpenCV are used. The results of this analysis are then sent to a server.
[0799] Input: User's face and voice data
[0800] Output: Identified sentiment information
[0801] Step 8: Customize notification content based on emotional information
[0802] The server customizes notification content based on identified emotional information. For example, it generates and sends a more reassuring message to a user who is feeling anxious. The customized message is then sent to the user's device as a push notification.
[0803] Input: Identified sentiment information
[0804] Output: Customized notification content
[0805] (Application Example 2)
[0806] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0807] Conventional earthquake evacuation guidance systems lack sufficient capabilities to quickly and efficiently guide evacuees to safety. Furthermore, they often provide generic evacuation instructions without considering the emotional needs of evacuees, resulting in unresolved psychological burdens. Additionally, the supply of necessary goods to evacuation centers is often insufficient, leading to poor living conditions. To address these issues, real-time information gathering and evacuation guidance, along with notifications that consider the emotions of evacuees and the rapid supply of necessary goods, are essential.
[0808] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotions. As a result, the user can acquire earthquake information in real time, move to the nearest evacuation shelter quickly and efficiently, and receive personalized messages to reduce psychological burden and realize a safe and secure evacuation. In addition, since the delivery of supplies using autonomous vehicles is also arranged, it becomes possible to supply necessary supplies to evacuation shelters quickly and efficiently.
[0809] "Means for collecting earthquake information in real time" refers to a device or system that acquires various earthquake-related data (such as the time of occurrence, epicenter, and seismic intensity) from reliable sources in real time when an earthquake occurs and stores it in a database.
[0810] "Means for obtaining the user's current location information" refers to a device or system that accurately obtains the user's current location using GPS functionality or other location information technologies.
[0811] "Means for searching for evacuation shelters" refers to a device or system that searches for the nearest evacuation shelter based on acquired location information and identifies the most suitable evacuation location for the user.
[0812] "Means of notifying users of information regarding evacuation shelters" refers to a device or system that notifies users' terminals of detailed information such as the name, address, distance, and route from their current location to a designated evacuation shelter.
[0813] "Means of recognizing user emotions" refers to devices or systems that use sensors such as cameras and microphones to analyze a user's emotions (e.g., reassurance, anxiety, fear, etc.) from their facial expressions and voice.
[0814] "Means of customizing notification content based on emotions" refers to a device or system that personalizes the content of evacuation shelter information notifications and generates appropriate messages according to the recognized emotions of the user.
[0815] "Means for generating a list of necessary supplies" refers to a device or system that matches the needs of the evacuation area with inventory data to create a list of required supplies.
[0816] "Means for selecting available supplies" refers to a device or system that allows users connected to the system to select available supplies and transmit that information to the server.
[0817] "Means for aggregating information on the provision of goods and arranging delivery" refers to a device or system that aggregates information on the provided goods, calculates the optimal delivery route, and arranges for the delivery of the goods.
[0818] "Means of delivering supplies using autonomous vehicles" refers to a device or system that uses autonomous vehicles to efficiently and quickly deliver necessary supplies to evacuation centers.
[0819] One embodiment of this invention is an evacuation guidance and supplies supply system using autonomous vehicles. This system collects earthquake information in real time, obtains the user's current location, searches for the optimal evacuation shelter, performs sentiment analysis, and then provides customized evacuation information. It also provides rapid supplies using autonomous vehicles.
[0820] Hardware configuration
[0821] Server: Manages earthquake information and supply data, and notifies users.
[0822] Device: Includes smartphones and tablets, cameras, microphones, and GPS modules, and acquires the user's location information and emotional information.
[0823] Autonomous vehicles: Used for transporting evacuees and delivering supplies.
[0824] Software Configuration
[0825] Earthquake Information Acquisition System: Collects data from the Japan Meteorological Agency and other sources in real time.
[0826] Location information acquisition system: Acquires GPS data to determine the user's current location.
[0827] Evacuation shelter search system: Identifies the nearest evacuation shelter from the database.
[0828] Notification system: Notifies users of evacuation shelter information.
[0829] Emotion recognition engine: Recognizes emotions from data acquired from cameras and microphones using tools such as TensorFlow.
[0830] Notification customization system: Customizes notification content based on sentiment analysis results.
[0831] Supplies Management System: Generates a list of necessary supplies, compiles the available supplies, and arranges for their delivery.
[0832] Automated vehicle control system: Used for transporting supplies and evacuees.
[0833] Specific example of processing procedure
[0834] 1. In the event of an earthquake, the server will collect earthquake information from the Japan Meteorological Agency and other sources and immediately store it in the database.
[0835] 2. The user launches the smartphone app and obtains their current location information using the GPS function. This information is sent to the server by the device.
[0836] 3. The server searches the database for the nearest evacuation shelter based on the user's current location. It generates information about the evacuation shelter (e.g., shelter name, address, distance, route from the current location) and sends it to the terminal.
[0837] 4. The device uses its camera and microphone to capture the user's face and voice, and sends this data to the server's emotion recognition engine.
[0838] 5. The emotion recognition engine uses TensorFlow to analyze emotions and sends the results to the notification customization system.
[0839] 6. Based on the sentiment analysis results, the server customizes and notifies users of personalized evacuation information.
[0840] 7. The server matches the needs of the evacuation area with inventory data and generates a list of necessary supplies. Users select the supplies they can provide and send that information to the server.
[0841] 8. The server aggregates information on the supplies to be provided, calculates the optimal delivery route, and arranges for the delivery of the supplies. Autonomous vehicles are used to deliver the supplies quickly.
[0842] Example (In the event of an earthquake in Tokyo)
[0843] If a user is in Chiyoda Ward, Tokyo, they launch a smartphone app. The device uses GPS to obtain its current location and sends it to the server. The server notifies the user that the nearest evacuation shelter is "Chiyoda Park." Furthermore, the camera identifies the user's face and the microphone collects their voice. Based on this, the emotion engine identifies the user as "anxious," and the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter." Simultaneously, users in other areas check the list of necessary supplies and send information about available supplies to the server. The server compiles the supply information and uses autonomous vehicles to quickly deliver the supplies to the shelter.
[0844] Example of a prompt
[0845] Obtain the user's current location (latitude: 35.6895, longitude: 139.6917) and search for the nearest shelter. Also, identify the user's emotions and generate an appropriate message. The user's face image is "user_image.jpg" and their voice data is "user_voice.wav".
[0846] In this way, the entire system works together, enabling swift and efficient support for evacuees.
[0847] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0848] Step 1:
[0849] The server collects earthquake information from reliable sources (e.g., the Japan Meteorological Agency) when an earthquake occurs. The collected data includes the time of the earthquake, the epicenter, and the seismic intensity. This information is acquired in real time and stored in a database. This allows for the rapid acquisition of detailed earthquake information.
[0850] Step 2:
[0851] After an earthquake, the user launches a smartphone app to request evacuation information. At this time, the device uses its GPS function to obtain the user's current location. This location information is then sent to a server. The input requires the current location (latitude and longitude), and this location information is sent to the server as output.
[0852] Step 3:
[0853] The server searches the database for the nearest evacuation shelter based on the received current location information. It matches the location information with the evacuation shelter data to generate information about the nearest shelter. This information includes details such as the shelter's name, address, distance, and directions from the current location. This information is then output to the next step.
[0854] Step 4:
[0855] The server notifies the user's terminal of the generated evacuation shelter information. This notification also includes detailed map information to the evacuation shelter. This allows the user to confirm the optimal evacuation route. The input requires evacuation shelter information and the user's terminal information, and the output is a notification sent.
[0856] Step 5:
[0857] The device identifies the user's face with a camera and collects audio with a microphone. The acquired facial image and audio data are sent to the server's emotion recognition engine. This emotion recognition engine analyzes the user's emotions using a generative AI model. The input requires facial image and audio data, and the output is the recognized emotion (e.g., reassurance, anxiety, fear).
[0858] Step 6:
[0859] The server receives results from the emotion recognition engine and customizes the notification content based on the identified emotion. For example, if the user is feeling anxious, it will generate a message such as, "Don't worry. There is plenty of space and supplies at the shelter." Emotional information is required as input, and a customized message is generated as output.
[0860] Step 7:
[0861] The server matches the needs and inventory data of the evacuation area and generates a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server. Needs data and inventory data are required as input, and the necessary supplies list is generated as output.
[0862] Step 8:
[0863] The server aggregates information on the donated supplies and verifies whether all necessary supplies are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the delivery of supplies using autonomous vehicles. This enables the necessary supplies to reach evacuation areas quickly. The input requires information on the donated supplies, and the output provides the delivery route.
[0864] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0865] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0866] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0867] [Third Embodiment]
[0868] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0869] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0870] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0871] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0872] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0873] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0874] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0875] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0876] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0877] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0878] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0879] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0880] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake. This system consists of the interaction of a server, terminals, and users.
[0881] Program Overview
[0882] The following programs are executed on this system:
[0883] Collection of earthquake information
[0884] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0885] Acquiring user location information and searching for evacuation shelters
[0886] When an earthquake occurs, the user launches a smartphone app. The device uses its GPS function to obtain its current location and sends this information to the server. Based on the received location information, the server searches its database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[0887] Notification of information about evacuation shelters
[0888] The server notifies the user's device of information regarding recommended evacuation locations (e.g., the name of the evacuation center, its address, and its distance from the user's current location). This notification also includes detailed map information to the evacuation center, allowing the user to head to the location based on this information.
[0889] Generating a list of necessary supplies and managing the supplies provided.
[0890] The server matches the needs of the evacuation area with inventory data and creates a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[0891] Tallying and arranging the delivery of donated supplies
[0892] The server aggregates information on the donated supplies and verifies whether all necessary items are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the supplies to be delivered. This ensures that necessary supplies reach evacuation areas quickly.
[0893] Specific example
[0894] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." User A clicks the provided link and evacuates while checking map information to the shelter.
[0895] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0896] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, ensuring that users can obtain appropriate evacuation information and that necessary supplies are supplied quickly.
[0897] The following describes the processing flow.
[0898] Specific processing of the program
[0899] Processing related to evacuation orders
[0900] Step 1:
[0901] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[0902] Step 2:
[0903] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[0904] Step 3:
[0905] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations are used.
[0906] Step 4:
[0907] Terminal: Sends the acquired current location information to the server.
[0908] Step 5:
[0909] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. When selecting an evacuation shelter, it considers the shelter's capacity and current congestion level.
[0910] Step 6:
[0911] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[0912] Step 7:
[0913] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[0914] Step 8:
[0915] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[0916] Step 9:
[0917] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[0918] Processing of requests for necessary supplies
[0919] Step 1:
[0920] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[0921] Step 2:
[0922] Server: Verify the user's authentication information and grant permission to log in.
[0923] Step 3:
[0924] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[0925] Step 4:
[0926] Server: Presents the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[0927] Step 5:
[0928] User: Select the supplies you can provide (e.g., 10 liters of drinking water, 5 blankets) and enter the information.
[0929] Step 6:
[0930] Terminal: Sends the entered supply provision information to the server.
[0931] Step 7:
[0932] Server: Aggregates the provided supply information and verifies that sufficient supplies are available. Furthermore, it develops the optimal delivery plan based on the provided supplies.
[0933] Step 8:
[0934] Server: Calculates the optimal delivery route and method, and arranges the delivery of goods. This process includes coordinating with logistics providers and setting delivery priorities.
[0935] Step 9:
[0936] Server: Notifies the supply provider that delivery arrangements are complete. This notification includes the scheduled delivery date and time and tracking information.
[0937] In this way, this system enables rapid evacuation support and efficient supply of necessary goods during earthquakes.
[0938] (Example 1)
[0939] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0940] When an earthquake strikes, it is crucial to quickly and accurately gather information and provide appropriate evacuation guidance to users. Furthermore, effectively supplying necessary goods to evacuation areas is also a critical issue. However, conventional systems struggled to handle such a comprehensive response, sometimes resulting in delays in information and shortages of supplies. This made it difficult to ensure the safety of evacuees and provide rapid assistance.
[0941] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0942] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation sites based on the current location information, means for notifying the user's terminal of information regarding the evacuation sites, means for matching demand and inventory data of the evacuation area and generating a list of necessary supplies, means for allowing the user to select available supplies, and means for aggregating supply provision information and arranging delivery. This enables rapid and accurate evacuation guidance and supply of goods in the event of an earthquake.
[0943] "Earthquake information" refers to data that includes information such as the time of the earthquake, the epicenter, and the seismic intensity.
[0944] "Methods for collecting data in real time" refers to methods for instantly acquiring earthquake information and storing it in a database.
[0945] A "user" refers to an individual or group that uses the system.
[0946] "Current location information" refers to data that includes the latitude and longitude of the user's current location.
[0947] "Means of obtaining current location information" refers to methods of obtaining a user's current location information using technologies such as GPS.
[0948] A "shelter" refers to a place where people can ensure their safety during an earthquake, such as a shelter or temporary evacuation site.
[0949] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[0950] "Information regarding evacuation shelters" refers to detailed information such as the name of the evacuation shelter, its address, distance from your current location, and its capacity.
[0951] "Means for notifying users of evacuation shelters on their devices" refers to means for transmitting information about evacuation shelters to users' devices.
[0952] An "evacuation zone" is an area affected by an earthquake where evacuation is necessary.
[0953] "Demand" refers to the amount of goods and services needed in an evacuation zone.
[0954] "Inventory data" refers to information about the stock of goods and services that can be supplied.
[0955] A "list of necessary supplies" is a list that shows a list of supplies needed in an evacuation area.
[0956] "Means of allowing users to select available supplies" refers to methods of allowing users to select the supplies they can provide and transmitting that information to the system.
[0957] "Information on the provision of goods" refers to detailed information (type, quantity, etc.) about the goods provided by users.
[0958] "Means for aggregating information on the provision of supplies and arranging delivery" refers to means for efficiently delivering necessary supplies based on the aggregated information on the provision of supplies.
[0959] "Map information" refers to geographical guidance information necessary for users to find their way to an evacuation site.
[0960] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake, and consists of the interaction of a server, terminals, and users. This system makes it possible to collect earthquake information in real time, provide appropriate evacuation information to users, and rapidly supply necessary goods.
[0961] Collection of earthquake information
[0962] The server collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency. This process involves sending HTTP requests and parsing the JSON data received as responses. Specific data includes the time of the earthquake, its epicenter, and its seismic intensity. The collected data is stored in a MySQL database.
[0963] Obtaining user location information
[0964] When an earthquake occurs, the user launches a dedicated smartphone app. The device (smartphone) obtains GPS data through location services. The obtained location data (latitude and longitude) is sent to a server via Firebase and stored in a database.
[0965] Search for evacuation shelters
[0966] The server searches its database for the nearest evacuation shelter based on the user's current location information. This process uses PostGIS to calculate geographical distances. From the calculation results, it retrieves detailed information such as the name, address, latitude, and longitude of the nearest evacuation shelter.
[0967] Notification of evacuation shelter information
[0968] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. This notification includes the name and address of the evacuation shelter, as well as map information including a Google Maps link. In this way, the user can confirm the route to the appropriate evacuation shelter.
[0969] Generating a list of necessary supplies
[0970] The server matches demand and inventory data for the evacuation area and generates a list of necessary supplies. Based on inventory data retrieved from the database, it creates a list of supplies needed in the evacuation area (e.g., drinking water, blankets, emergency food, etc.) and displays it on the system's web interface.
[0971] Management and tabulation of donated goods
[0972] Users (who are outside the evacuation zone) log in and select the supplies they can provide. The selected supply information is sent to the server and stored in the database. The server aggregates the supply information provided by each user and checks whether the necessary supplies have been collected.
[0973] Delivery arrangements
[0974] The server calculates the optimal delivery route based on the aggregated supply information. Based on the calculated delivery route, it arranges for the delivery of supplies through the APIs of partner logistics companies. Finally, it notifies the supply providers and the evacuation areas of the delivery status of the supplies.
[0975] Specific example
[0976] For example, suppose an earthquake occurs in Tokyo, and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app and requests evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that a "park" evacuation shelter in Chiyoda Ward is the most suitable evacuation location and notifies user A of this information. User A clicks on the map link and evacuates while checking the route to the evacuation shelter.
[0977] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[0978] Example of a prompt
[0979] "An earthquake has occurred, and users need evacuation information. Please design a system that notifies users of the optimal evacuation location and route. Additionally, please add a mechanism to provide users outside the evacuation zone with information on necessary supplies and to arrange for their delivery."
[0980] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0981] Step 1:
[0982] The server collects earthquake information in real time. Specifically, it sends HTTP requests to APIs of information sources such as the Japan Meteorological Agency. The input includes the API endpoint URL and request parameters, and the output is earthquake information in JSON format. This received data contains information about the time of the earthquake, the epicenter, and the seismic intensity, which is parsed and stored in a MySQL database.
[0983] Step 2:
[0984] When an earthquake occurs, the user launches a smartphone app. The device (smartphone) obtains GPS data using location services. The input includes raw data from the GPS sensor, and the output is the latitude and longitude of the current location. This location information is sent to the server via Firebase. The server receives this data and stores it in a database.
[0985] Step 3:
[0986] The server searches for the nearest evacuation shelter from its database based on the user's current location information. Specifically, it uses PostGIS to calculate geographical distances based on the received latitude and longitude. The input includes the user's location information and database information on evacuation shelters, and the output provides the name, address, latitude, and longitude of the optimal evacuation shelter.
[0987] Step 4:
[0988] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. The input includes detailed information about the evacuation shelter (name, address, map link), and the output is a push notification of the evacuation shelter information sent to the user's smartphone. The notification also includes a detailed map link of the evacuation shelter, which the user can click to view the map information.
[0989] Step 5:
[0990] The server retrieves demand and inventory data for the evacuation area from a database and generates a list of necessary supplies. The input includes demand and inventory data for the evacuation area, and the output is a list of necessary supplies (e.g., drinking water, blankets, emergency food, etc.). This list is presented through the system's web interface.
[0991] Step 6:
[0992] Users (who are outside the evacuation zone) log in and select the supplies they can provide. Specifically, they enter details of the supplies they can provide via a web interface and submit them. The input includes the username, the type and quantity of supplies to be provided, and the information about the supplies provided is sent to the server and stored in the database.
[0993] Step 7:
[0994] The server checks whether all necessary supplies are available based on the aggregated supply information. Input includes supply information and required supply lists provided by each user, and output provides the total amount of supplies and a list of missing supplies. Based on this, the server calculates the optimal delivery route.
[0995] Step 8:
[0996] The server calculates the optimal delivery route and then arranges for the delivery of supplies through the API of a partner logistics company. Inputs include the delivery address, detailed information about the supplies, and optimal route information, and the output is the completion of the supply delivery arrangement. The delivery status is also monitored, and notifications are sent to the supply provider and the evacuation area.
[0997] (Application Example 1)
[0998] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0999] During an earthquake, rapid and accurate evacuation guidance is crucial. However, conventional systems are insufficient for real-time earthquake information gathering, user location acquisition, and shelter search and notification, often leading to delays in evacuation. Furthermore, the supply of necessary goods in evacuation areas may be delayed, posing a challenge in responding quickly to the needs of evacuees. In particular, rapid response is extremely important in the event of a large-scale earthquake, but conventional methods struggle to adequately achieve this.
[1000] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[1001] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for generating a list of necessary supplies based on the needs of the evacuation area using a generative model, means for notifying the user of the generated evacuation shelter and necessary supplies information, and means for generating prompt sentences for input into the generative AI model. This enables rapid and accurate evacuation guidance and the rapid supply of supplies to meet the needs of the evacuation area in the event of an earthquake.
[1002] "Earthquake information" refers to information that includes data such as the time of the earthquake, the epicenter, and the seismic intensity.
[1003] "Real-time collection" means collecting information almost immediately after an earthquake occurs.
[1004] "User's current location information" refers to information about the user's current location, identified using means such as GPS.
[1005] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[1006] "Information regarding evacuation shelters" includes information such as the name of the evacuation shelter, its address, and its distance from your current location.
[1007] A "generative model" is an algorithm that generates the desired output based on a given set of input data.
[1008] A "list of necessary supplies" is a list of essential items generated by matching the needs of the evacuation area with inventory data.
[1009] "Information on the provision of supplies" refers to data regarding the types and quantities of supplies that can be provided.
[1010] "Delivery arrangements" refer to the procedures for ensuring that supplies are delivered quickly to designated evacuation areas.
[1011] A "generative AI model" is an artificial intelligence system designed to perform specific tasks or process data using machine learning techniques.
[1012] A "prompt statement" is an input statement to a generative AI model, in the form of instructions or questions to obtain the required output.
[1013] A system for carrying out this invention includes the following configuration.
[1014] System configuration and hardware / software used
[1015] 1. Servers: Cloud services such as AWS and Google Cloud will be used for real-time data processing and database management. MySQL and PostgreSQL will be used as databases to store earthquake information, evacuation center information, and information on the provision of supplies.
[1016] 2. Earthquake Information Collection API: Using APIs from the Japan Meteorological Agency and other sources, data such as the time of earthquake occurrence, epicenter, and seismic intensity are obtained in real time.
[1017] 3. Smartphone device: Uses an iOS or Android smartphone and obtains the user's current location information using GPS functionality. Data communication with the server is performed via internet connection and notification services.
[1018] 4. Generative AI Model: Using machine learning techniques, this model generates lists of necessary supplies based on the needs of evacuation areas and generates prompt messages. The model is built and operated using libraries such as TensorFlow and PyTorch.
[1019] Processing flow
[1020] 1. Gathering earthquake information:
[1021] The server uses an earthquake information API to acquire earthquake data in real time and stores it in a database.
[1022] 2. Obtaining the user's location information:
[1023] Smartphones use GPS functionality to obtain the user's current location and send it to a server. This location information is used to search for evacuation shelters.
[1024] 3. Searching for and notifying evacuation shelters:
[1025] The server searches its database for the nearest evacuation shelter based on the user's current location. The server then notifies the user's smartphone of the shelter's information. The notification includes the shelter's name, address, distance from the user's current location, and route information.
[1026] 4. Generating a list of necessary supplies:
[1027] The server uses a generative AI model to match the needs of the evacuation area with inventory data and generate a list of necessary supplies. This list is provided to users in other regions and serves as a basis for selecting relief supplies.
[1028] 5. Management of supply information and arrangement of delivery:
[1029] The provided supply information is compiled on a server, the optimal delivery route is calculated, and arrangements are made with logistics companies. This ensures that supplies are delivered quickly.
[1030] Specific example
[1031] For example, if an earthquake occurs in Tokyo, the system will operate as follows:
[1032] (Example of a prompt message)
[1033] During an earthquake:
[1034] User's current location: Chiyoda-ku, Tokyo
[1035] Shelter search criteria: The shelter closest to the user.
[1036] Notification content: Detailed route information to the nearest evacuation shelter and evacuation destination.
[1037] Based on this prompt, the server retrieves information about the nearest evacuation shelter, "Chiyoda Park," and notifies the user. The notification includes the message, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." The user can click the provided link and evacuate while viewing map information to the shelter.
[1038] At the same time, users outside the evacuation zone are presented with a list of necessary supplies and can select the items they can provide and send them to the server. Based on this information, the server compiles the supplies, arranges for their delivery, and delivers them to the evacuation centers via the most optimal route.
[1039] In this way, this system enables rapid evacuation guidance and the supply of necessary goods to evacuation areas during earthquakes.
[1040] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[1041] Step 1: Gathering earthquake information
[1042] The server calls the Japan Meteorological Agency's earthquake information API to obtain real-time data such as the time of earthquake occurrence, epicenter, and seismic intensity. The obtained data is stored in a MySQL or PostgreSQL database. The input is earthquake data obtained from the earthquake information API, and the output is earthquake information stored in the database.
[1043] Step 2: Obtaining the user's location information
[1044] The device (the user's smartphone) obtains its current location information using the built-in GPS function. The obtained location information is transmitted to the server via the internet. The input is the user's current location information obtained from GPS, and the output is the location information data transmitted to the server.
[1045] Step 3: Search for an evacuation shelter
[1046] The server uses the user's current location information to search the database for the nearest evacuation shelter. This uses an algorithm that calculates distance using the location information to identify the closest shelter. The input is the user's current location information, and the output is the nearest evacuation shelter information.
[1047] Step 4: Notification of evacuation shelter information
[1048] When the server retrieves information about the nearest evacuation shelter, it sends a notification to the user's device. The notification includes the name and address of the shelter, the distance from the current location, and detailed route information. Specifically, the server sends a push notification to the device. The input is the information about the nearest evacuation shelter, and the output is the notification message sent to the user.
[1049] Step 5: Generate a list of necessary supplies
[1050] The server uses a generative AI model to generate a list of necessary supplies based on the needs and inventory data of the evacuation area. Specifically, it optimizes the supply of goods to meet the estimated needs of the evacuation area. The input is the needs data and inventory data of the evacuation area, and the output is a list of necessary supplies.
[1051] Step 6: Choosing the Provision of Supplies
[1052] Users outside the evacuation zone log into the system using a terminal and select the supplies they can provide based on the list of necessary supplies provided by the server. The selection information is sent to the server. The input is the information of the supplies selected by the user, and the output is the information of the supplies provided that is sent to the server.
[1053] Step 7: Compiling information on supply provision and arranging delivery.
[1054] The server uses the collected supply information to verify that all necessary supplies are available and calculates the optimal delivery route. It then calls the logistics provider API to arrange the actual delivery. The input is the aggregated supply information, and the output is the delivery arrangement information sent to the logistics provider.
[1055] Step 8: Notification of the list of necessary supplies and shelter information.
[1056] The server generates prompt statements for input to the AI model, uses them to generate notification messages containing information on each evacuation center and necessary supplies, and sends them to personnel and support staff in the evacuation area. For example, a prompt statement like "When an earthquake occurs: User's current location: Chiyoda-ku, Tokyo; Evacuation center search criteria: Evacuation center closest to the user; Notification content: Detailed route information to the nearest evacuation center and evacuation destination" is used. The input is the prompt statement, and the output is the generated notification message.
[1057] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[1058] This invention provides more personalized support by combining a system designed for rapid evacuation guidance and supply of necessary goods during an earthquake with an emotion engine that recognizes the user's emotions. This system consists of the interaction of a server, a terminal, and the user.
[1059] Program Overview
[1060] The following programs are executed on this system:
[1061] Collection of earthquake information
[1062] Server: Collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency, and stores various earthquake-related data (occurrence time, epicenter, seismic intensity, etc.) in a database.
[1063] Acquiring user location information and searching for evacuation shelters
[1064] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[1065] Device: Uses GPS functionality to obtain current location information and sends this information to the server.
[1066] Server: Based on the received location information, it searches the database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[1067] Notification of information about evacuation shelters
[1068] Server: Notifies the user's device of information regarding recommended evacuation locations (e.g., name, address, distance, and route from the current location of the evacuation center). This notification also includes detailed map information to the evacuation center, allowing the user to head to the evacuation center based on this information.
[1069] Generating a list of necessary supplies and managing the supplies provided.
[1070] Server: Matches the needs and inventory data of the evacuation area to create a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[1071] Tallying and arranging the delivery of donated supplies
[1072] Server: Aggregates information on the donated supplies and verifies whether all necessary supplies are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the delivery of the supplies. This ensures that necessary supplies reach evacuation areas quickly.
[1073] Support by an emotional engine
[1074] In addition to the evacuation order and supplies supply functions mentioned above, this system incorporates an emotion engine that recognizes the user's emotions, providing more personalized support.
[1075] Identifying emotions
[1076] Terminal: Acquires user voice and facial expression information and sends it to the emotion engine.
[1077] Emotion Engine: Analyzes acquired voice and facial expression information to identify the user's emotions (e.g., relief, anxiety, fear, etc.).
[1078] Customizing notification content
[1079] Server: Customizes shelter information notifications based on the emotions of identified users. For example, users with high stress levels will receive messages with more polite and calming language.
[1080] Specific example
[1081] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[1082] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[1083] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[1084] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, and furthermore, by utilizing an emotion engine, it can provide personalized support to users.
[1085] The following describes the processing flow.
[1086] Processing related to evacuation orders
[1087] Step 1:
[1088] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[1089] Step 2:
[1090] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[1091] Step 3:
[1092] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations will be used to obtain location information.
[1093] Step 4:
[1094] Terminal: Sends the acquired current location information to the server.
[1095] Step 5:
[1096] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. Factors such as safety, capacity, and current congestion are considered when selecting an evacuation shelter.
[1097] Step 6:
[1098] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[1099] Step 7:
[1100] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[1101] Step 8:
[1102] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[1103] Step 9:
[1104] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[1105] Processing of requests for necessary supplies
[1106] Step 1:
[1107] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[1108] Step 2:
[1109] Server: Verify the user's authentication information and grant permission to log in.
[1110] Step 3:
[1111] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[1112] Step 4:
[1113] Server: Presents the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[1114] Step 5:
[1115] User: Select the supplies you can provide (e.g., 10 liters of drinking water, 5 blankets) and enter the information.
[1116] Step 6:
[1117] Terminal: Sends the entered supply provision information to the server.
[1118] Step 7:
[1119] Server: Aggregates the provided supply information and verifies that sufficient supplies are available. Furthermore, it develops the optimal delivery plan based on the provided supplies.
[1120] Step 8:
[1121] Server: Calculates the optimal delivery route and method, and arranges the delivery of goods. This process includes coordinating with logistics providers and setting delivery priorities.
[1122] Step 9:
[1123] Server: Notifies the supply provider that delivery arrangements are complete. This notification includes the scheduled delivery date and time and tracking information.
[1124] Support by an emotional engine
[1125] Processing related to emotion recognition
[1126] Step 1:
[1127] Device: Collects user voice information via microphone and captures facial expressions with a camera.
[1128] Step 2:
[1129] Terminal: Sends collected voice and facial expression information to the emotion engine.
[1130] Step 3:
[1131] Emotion Engine: Analyzes voice and facial expression information to identify the user's emotions (e.g., relief, anxiety, fear, etc.).
[1132] Step 4:
[1133] Emotion engine: Sends identified emotion information to the server.
[1134] Processing related to emotion-based notification customization
[1135] Step 1:
[1136] Server: Receives sentiment information of identified users.
[1137] Step 2:
[1138] Server: Customizes the content of evacuation shelter information notifications based on the user's emotions. For example, it generates more polite and reassuring messages for users with high stress levels.
[1139] Step 3:
[1140] Server: Sends customized notification content to the user's device. It also sends an additional message: "Don't worry, there is plenty of space and supplies at the shelter."
[1141] As a concrete example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[1142] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[1143] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[1144] Thus, this invention provides rapid evacuation support and provision of necessary supplies during earthquakes, and further enables personalized support to users by utilizing an emotion engine.
[1145] (Example 2)
[1146] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[1147] During an earthquake, extremely rapid and accurate evacuation support is required. However, conventional systems have the problem of providing general and uniform evacuation information, which does not adequately consider the individual circumstances and emotional states of users. Furthermore, while rapid supply of goods is essential, conventional systems sometimes made it difficult to carry out this smoothly. To solve these problems, a system is needed that allows for more detailed responses in evacuation support and supply of goods.
[1148] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[1149] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotion information. This enables rapid and accurate evacuation support while taking into account the emotional state of each individual user. It also enables the smooth and rapid provision of supplies necessary for evacuation support.
[1150] "Earthquake information" refers to detailed information about the occurrence of an earthquake, specifically including data such as the time of occurrence, epicenter, and seismic intensity.
[1151] "Means of real-time collection" refers to technological means for instantly acquiring earthquake information via the internet and storing it in a database.
[1152] "User's current location information" refers to the specific latitude and longitude information of the user's current location.
[1153] "Means for obtaining current location information" refers to technical means that use GPS functionality to obtain the user's current location.
[1154] "Methods for searching for evacuation shelters" refers to technical means that identify the most appropriate evacuation location based on the user's current location from a database.
[1155] "Information regarding evacuation shelters" refers to detailed data about evacuation shelters, such as their names, addresses, distances, and map information.
[1156] "Means of notification" refers to technical means of transmitting relevant information to users via smartphones or other communication devices.
[1157] "Means of recognizing emotions" refers to technological means for analyzing and identifying a user's emotional state from their voice and facial expressions.
[1158] "Emotional information" refers to data that indicates the user's emotional state (e.g., feeling safe, anxious, fearful, etc.).
[1159] "Means for customizing notification content" refers to technical means that adjust the content of messages and notifications sent based on the user's emotional information.
[1160] "Supplies" refers to basic necessities of life such as drinking water, food, and blankets that are needed in evacuation shelters.
[1161] A "list of necessary supplies" refers to a list of items that are in short supply in the evacuation area.
[1162] "Supplies that can be provided" refers to supplies that can be supplied by users outside the affected area.
[1163] "Information on the provision of supplies" refers to detailed data about the supplies that can be provided (e.g., type, quantity).
[1164] "Means for aggregating and arranging delivery" refers to technical means that aggregate the provided material information, calculate the optimal delivery route, and execute the delivery procedures for the materials.
[1165] This invention is a system aimed at rapid evacuation guidance and supply of necessary goods during an earthquake, and further provides more personalized support by recognizing the user's emotions. This system consists of the interaction of a server, terminals, and users.
[1166] Collection of earthquake information
[1167] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency (JMA). Using the JMA's API, it retrieves earthquake information such as the time of occurrence, epicenter, and seismic intensity, and stores this information in a database (e.g., MySQL). The server periodically executes scripts to retrieve data from the sources and update the database.
[1168] Acquiring user location information and searching for evacuation shelters
[1169] Users launch a smartphone app when an earthquake occurs to request evacuation information.
[1170] The device uses GPS functionality to obtain its current location. The acquired location information is configured to be sent to a server.
[1171] The server searches the database for the nearest evacuation shelter based on the received location information. Specifically, it uses an SQL SELECT statement to compare the user's location information with evacuation shelter data to identify the most suitable shelter.
[1172] Notification of information about evacuation shelters
[1173] The server generates information about recommended evacuation locations and notifies the user's device. Specifically, it creates a notification that includes the name, address, distance, and map information of the evacuation center, and sends it as a push notification via a smartphone app.
[1174] Generating a list of necessary supplies and managing the supplies provided.
[1175] The server matches the needs of the evacuation area with inventory data and generates a list of necessary supplies. The generated list is then presented to users outside the affected area who are connected to the system.
[1176] Users select the supplies they can provide and send that information to the server. The server stores and aggregates this information in a database.
[1177] Tallying and arranging the delivery of donated supplies
[1178] The server aggregates information on supplies submitted by users and verifies whether all necessary supplies are available. Based on the aggregated results, it calculates the optimal delivery route and arranges for the supplies to be delivered. Delivery arrangements are automated using the delivery company's API.
[1179] Support by an emotional engine
[1180] The device uses its camera and microphone to acquire the user's voice and facial expression information. The acquired information is then sent to the emotion engine.
[1181] The emotion engine analyzes acquired audio and facial expression information to identify the user's emotions. Machine learning models (e.g., TensorFlow, OpenCV) are used for emotion identification.
[1182] The server customizes evacuation notifications based on identified emotional information. For example, it sends a reassuring message to users who are feeling stressed.
[1183] Specific example
[1184] If an earthquake occurs in Tokyo and user A is in Chiyoda Ward, user A will launch a smartphone app after the earthquake to request evacuation information. The device will use GPS to obtain its current location and send this information to the server. The server will identify "Chiyoda Park" as the best evacuation shelter and send a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[1185] Furthermore, the device uses its camera to identify user A's face and its microphone to collect audio. The emotion engine analyzes this information and identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[1186] Simultaneously, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation zone. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and, once the necessary supplies are gathered, calculates the optimal delivery route and arranges for delivery.
[1187] In this way, the present invention can provide users with rapid and accurate evacuation guidance and the prompt supply of necessary materials. Furthermore, by utilizing an emotion engine, it is possible to provide personalized support tailored to the individual circumstances of each user.
[1188] The flow of the specific processing in Example 2 will be explained using Figure 13.
[1189] Step 1: Gathering earthquake information
[1190] The server collects earthquake information in real time from sources such as the Japan Meteorological Agency. First, the server sends a request to the Japan Meteorological Agency's API and retrieves earthquake information returned in JSON format. This includes the time of occurrence, epicenter, and seismic intensity. The server then analyzes this data and stores it in the database using INSERT statements.
[1191] Input: Earthquake information from the Japan Meteorological Agency API
[1192] Output: Earthquake information stored in the database
[1193] Step 2: Obtain the user's current location information
[1194] When an earthquake occurs, the user launches a smartphone app to request evacuation information. The app uses the smartphone's GPS function to obtain the user's current location. The app then sends the obtained latitude and longitude information to the server's API as a POST request.
[1195] Input: Latitude and longitude information obtained via GPS
[1196] Output: Current location information sent to the server
[1197] Step 3: Search for an evacuation shelter
[1198] The server searches the database for the nearest shelter based on the received location information. First, it executes an SQL query that compares the received latitude and longitude information with the shelter data and calculates the distance. It identifies the shelter with the shortest distance and returns that information as a response.
[1199] Input: User's current location information, evacuation shelter database
[1200] Output: Information on the best evacuation shelters
[1201] Step 4: Notification of evacuation shelter information
[1202] The server generates information about recommended evacuation shelters (e.g., shelter name, address, distance, map information). This information is sent to the app as a push notification. The notification is configured to include a link to the evacuation shelter and route guidance.
[1203] Input: Information on the best evacuation shelter
[1204] Output: Push notification to user's device
[1205] Step 5: Generate a list of necessary supplies and manage the supplies provided.
[1206] The server matches the needs of the evacuation area with inventory data to create a list of necessary supplies. It retrieves needs information from the database, matches it with inventory data, and generates a list of necessary supplies. This list is presented to users outside the affected area via the app. Users select the supplies they can provide and send that information to the server.
[1207] Input: Needs information for the evacuation area, inventory data
[1208] Output: List of required supplies, information on supplies provided by users
[1209] Step 6: Tallying and arranging delivery of donated supplies
[1210] The server aggregates information on the submitted supplies. It verifies that all necessary supplies are present and uses the delivery company's API to calculate the optimal delivery route. It generates delivery labels and route information to arrange for quick delivery.
[1211] Input: Information on supplies provided by the user, delivery company API
[1212] Output: Aggregated material data, delivery labels, and route information
[1213] Step 7: User emotion recognition
[1214] The device uses its camera and microphone to capture the user's face and voice. This information is sent to an emotion engine, which performs analysis to identify the user's emotional state. Specifically, TensorFlow and OpenCV are used. The results of this analysis are then sent to a server.
[1215] Input: User's face and voice data
[1216] Output: Identified sentiment information
[1217] Step 8: Customize notification content based on emotional information
[1218] The server customizes notification content based on identified emotional information. For example, it generates and sends a more reassuring message to a user who is feeling anxious. The customized message is then sent to the user's device as a push notification.
[1219] Input: Identified sentiment information
[1220] Output: Customized notification content
[1221] (Application Example 2)
[1222] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[1223] Conventional earthquake evacuation guidance systems lack sufficient capabilities to quickly and efficiently guide evacuees to safety. Furthermore, they often provide generic evacuation instructions without considering the emotional needs of evacuees, resulting in unresolved psychological burdens. Additionally, the supply of necessary goods to evacuation centers is often insufficient, leading to poor living conditions. To address these issues, real-time information gathering and evacuation guidance, along with notifications that consider the emotions of evacuees and the rapid supply of necessary goods, are essential.
[1224] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotions. As a result, the user can acquire earthquake information in real time, move to the nearest evacuation shelter quickly and efficiently, and receive personalized messages to reduce psychological burden and realize a safe and secure evacuation. In addition, since the delivery of supplies using autonomous vehicles is also arranged, it becomes possible to supply necessary supplies to evacuation shelters quickly and efficiently.
[1225] "Means for collecting earthquake information in real time" refers to a device or system that acquires various earthquake-related data (such as the time of occurrence, epicenter, and seismic intensity) from reliable sources in real time when an earthquake occurs and stores it in a database.
[1226] "Means for obtaining the user's current location information" refers to a device or system that accurately obtains the user's current location using GPS functionality or other location information technologies.
[1227] "Means for searching for evacuation shelters" refers to a device or system that searches for the nearest evacuation shelter based on acquired location information and identifies the most suitable evacuation location for the user.
[1228] "Means of notifying users of information regarding evacuation shelters" refers to a device or system that notifies users' terminals of detailed information such as the name, address, distance, and route from their current location to a designated evacuation shelter.
[1229] "Means of recognizing user emotions" refers to devices or systems that use sensors such as cameras and microphones to analyze a user's emotions (e.g., reassurance, anxiety, fear, etc.) from their facial expressions and voice.
[1230] "Means of customizing notification content based on emotions" refers to a device or system that personalizes the content of evacuation shelter information notifications and generates appropriate messages according to the recognized emotions of the user.
[1231] "Means for generating a list of necessary supplies" refers to a device or system that matches the needs of the evacuation area with inventory data to create a list of required supplies.
[1232] "Means for selecting available supplies" refers to a device or system that allows users connected to the system to select available supplies and transmit that information to the server.
[1233] "Means for aggregating information on the provision of goods and arranging delivery" refers to a device or system that aggregates information on the provided goods, calculates the optimal delivery route, and arranges for the delivery of the goods.
[1234] "Means of delivering supplies using autonomous vehicles" refers to a device or system that uses autonomous vehicles to efficiently and quickly deliver necessary supplies to evacuation centers.
[1235] One embodiment of this invention is an evacuation guidance and supplies supply system using autonomous vehicles. This system collects earthquake information in real time, obtains the user's current location, searches for the optimal evacuation shelter, performs sentiment analysis, and then provides customized evacuation information. It also provides rapid supplies using autonomous vehicles.
[1236] Hardware configuration
[1237] Server: Manages earthquake information and supply data, and notifies users.
[1238] Device: Includes smartphones and tablets, cameras, microphones, and GPS modules, and acquires the user's location information and emotional information.
[1239] Autonomous vehicles: Used for transporting evacuees and delivering supplies.
[1240] Software Configuration
[1241] Earthquake Information Acquisition System: Collects data from the Japan Meteorological Agency and other sources in real time.
[1242] Location information acquisition system: Acquires GPS data to determine the user's current location.
[1243] Evacuation shelter search system: Identifies the nearest evacuation shelter from the database.
[1244] Notification system: Notifies users of evacuation shelter information.
[1245] Emotion recognition engine: Recognizes emotions from data acquired from cameras and microphones using tools such as TensorFlow.
[1246] Notification customization system: Customizes notification content based on sentiment analysis results.
[1247] Supplies Management System: Generates a list of necessary supplies, compiles the available supplies, and arranges for their delivery.
[1248] Automated vehicle control system: Used for transporting supplies and evacuees.
[1249] Specific example of processing procedure
[1250] 1. In the event of an earthquake, the server will collect earthquake information from the Japan Meteorological Agency and other sources and immediately store it in the database.
[1251] 2. The user launches the smartphone app and obtains their current location information using the GPS function. This information is sent to the server by the device.
[1252] 3. The server searches the database for the nearest evacuation shelter based on the user's current location. It generates information about the evacuation shelter (e.g., shelter name, address, distance, route from the current location) and sends it to the terminal.
[1253] 4. The device uses its camera and microphone to capture the user's face and voice, and sends this data to the server's emotion recognition engine.
[1254] 5. The emotion recognition engine uses TensorFlow to analyze emotions and sends the results to the notification customization system.
[1255] 6. Based on the sentiment analysis results, the server customizes and notifies users of personalized evacuation information.
[1256] 7. The server matches the needs of the evacuation area with inventory data and generates a list of necessary supplies. Users select the supplies they can provide and send that information to the server.
[1257] 8. The server aggregates information on the supplies to be provided, calculates the optimal delivery route, and arranges for the delivery of the supplies. Autonomous vehicles are used to deliver the supplies quickly.
[1258] Example (In the event of an earthquake in Tokyo)
[1259] If a user is in Chiyoda Ward, Tokyo, they launch a smartphone app. The device uses GPS to obtain its current location and sends it to the server. The server notifies the user that the nearest evacuation shelter is "Chiyoda Park." Furthermore, the camera identifies the user's face and the microphone collects their voice. Based on this, the emotion engine identifies the user as "anxious," and the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter." Simultaneously, users in other areas check the list of necessary supplies and send information about available supplies to the server. The server compiles the supply information and uses autonomous vehicles to quickly deliver the supplies to the shelter.
[1260] Example of a prompt
[1261] Obtain the user's current location (latitude: 35.6895, longitude: 139.6917) and search for the nearest shelter. Also, identify the user's emotions and generate an appropriate message. The user's face image is "user_image.jpg" and their voice data is "user_voice.wav".
[1262] In this way, the entire system works together, enabling swift and efficient support for evacuees.
[1263] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[1264] Step 1:
[1265] The server collects earthquake information from reliable sources (e.g., the Japan Meteorological Agency) when an earthquake occurs. The collected data includes the time of the earthquake, the epicenter, and the seismic intensity. This information is acquired in real time and stored in a database. This allows for the rapid acquisition of detailed earthquake information.
[1266] Step 2:
[1267] After an earthquake, the user launches a smartphone app to request evacuation information. At this time, the device uses its GPS function to obtain the user's current location. This location information is then sent to a server. The input requires the current location (latitude and longitude), and this location information is sent to the server as output.
[1268] Step 3:
[1269] The server searches the database for the nearest evacuation shelter based on the received current location information. It matches the location information with the evacuation shelter data to generate information about the nearest shelter. This information includes details such as the shelter's name, address, distance, and directions from the current location. This information is then output to the next step.
[1270] Step 4:
[1271] The server notifies the user's terminal of the generated evacuation shelter information. This notification also includes detailed map information to the evacuation shelter. This allows the user to confirm the optimal evacuation route. The input requires evacuation shelter information and the user's terminal information, and the output is a notification sent.
[1272] Step 5:
[1273] The device identifies the user's face with a camera and collects audio with a microphone. The acquired facial image and audio data are sent to the server's emotion recognition engine. This emotion recognition engine analyzes the user's emotions using a generative AI model. The input requires facial image and audio data, and the output is the recognized emotion (e.g., reassurance, anxiety, fear).
[1274] Step 6:
[1275] The server receives results from the emotion recognition engine and customizes the notification content based on the identified emotion. For example, if the user is feeling anxious, it will generate a message such as, "Don't worry. There is plenty of space and supplies at the shelter." Emotional information is required as input, and a customized message is generated as output.
[1276] Step 7:
[1277] The server matches the needs and inventory data of the evacuation area and generates a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server. Needs data and inventory data are required as input, and the necessary supplies list is generated as output.
[1278] Step 8:
[1279] The server aggregates information on the donated supplies and verifies whether all necessary supplies are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the delivery of supplies using autonomous vehicles. This enables the necessary supplies to reach evacuation areas quickly. The input requires information on the donated supplies, and the output provides the delivery route.
[1280] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[1281] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1282] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[1283] [Fourth Embodiment]
[1284] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[1285] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1286] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1287] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[1288] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[1289] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[1290] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[1291] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[1292] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[1293] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1294] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1295] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[1296] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1297] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake. This system consists of the interaction of a server, terminals, and users.
[1298] Program Overview
[1299] The following programs are executed on this system:
[1300] Collection of earthquake information
[1301] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[1302] Acquiring user location information and searching for evacuation shelters
[1303] When an earthquake occurs, the user launches a smartphone app. The device uses its GPS function to obtain its current location and sends this information to the server. Based on the received location information, the server searches its database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[1304] Notification of information about evacuation shelters
[1305] The server notifies the user's device of information regarding recommended evacuation locations (e.g., the name of the evacuation center, its address, and its distance from the user's current location). This notification also includes detailed map information to the evacuation center, allowing the user to head to the location based on this information.
[1306] Generating a list of necessary supplies and managing the supplies provided.
[1307] The server matches the needs of the evacuation area with inventory data and creates a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[1308] Tallying and arranging the delivery of donated supplies
[1309] The server aggregates information on the donated supplies and verifies whether all necessary items are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the supplies to be delivered. This ensures that necessary supplies reach evacuation areas quickly.
[1310] Specific example
[1311] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." User A clicks the provided link and evacuates while checking map information to the shelter.
[1312] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[1313] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, ensuring that users can obtain appropriate evacuation information and that necessary supplies are supplied quickly.
[1314] The following describes the processing flow.
[1315] Specific processing of the program
[1316] Processing related to evacuation orders
[1317] Step 1:
[1318] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[1319] Step 2:
[1320] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[1321] Step 3:
[1322] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations are used.
[1323] Step 4:
[1324] Terminal: Sends the acquired current location information to the server.
[1325] Step 5:
[1326] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. When selecting an evacuation shelter, it considers the shelter's capacity and current congestion level.
[1327] Step 6:
[1328] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[1329] Step 7:
[1330] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[1331] Step 8:
[1332] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[1333] Step 9:
[1334] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[1335] Processing of requests for necessary supplies
[1336] Step 1:
[1337] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[1338] Step 2:
[1339] Server: Verify the user's authentication information and grant permission to log in.
[1340] Step 3:
[1341] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[1342] Step 4:
[1343] Server: Presents the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[1344] Step 5:
[1345] User: Select the supplies you can provide (e.g., 10 liters of drinking water, 5 blankets) and enter the information.
[1346] Step 6:
[1347] Terminal: Sends the entered supply provision information to the server.
[1348] Step 7:
[1349] Server: Aggregates the provided supply information and verifies that sufficient supplies are available. Furthermore, it develops the optimal delivery plan based on the provided supplies.
[1350] Step 8:
[1351] Server: Calculates the optimal delivery route and method, and arranges the delivery of goods. This process includes coordinating with logistics providers and setting delivery priorities.
[1352] Step 9:
[1353] Server: Notifies the supply provider that delivery arrangements are complete. This notification includes the scheduled delivery date and time and tracking information.
[1354] In this way, this system enables rapid evacuation support and efficient supply of necessary goods during earthquakes.
[1355] (Example 1)
[1356] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1357] When an earthquake strikes, it is crucial to quickly and accurately gather information and provide appropriate evacuation guidance to users. Furthermore, effectively supplying necessary goods to evacuation areas is also a critical issue. However, conventional systems struggled to handle such a comprehensive response, sometimes resulting in delays in information and shortages of supplies. This made it difficult to ensure the safety of evacuees and provide rapid assistance.
[1358] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[1359] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation sites based on the current location information, means for notifying the user's terminal of information regarding the evacuation sites, means for matching demand and inventory data of the evacuation area and generating a list of necessary supplies, means for allowing the user to select available supplies, and means for aggregating supply provision information and arranging delivery. This enables rapid and accurate evacuation guidance and supply of goods in the event of an earthquake.
[1360] "Earthquake information" refers to data that includes information such as the time of the earthquake, the epicenter, and the seismic intensity.
[1361] "Methods for collecting data in real time" refers to methods for instantly acquiring earthquake information and storing it in a database.
[1362] A "user" refers to an individual or group that uses the system.
[1363] "Current location information" refers to data that includes the latitude and longitude of the user's current location.
[1364] "Means of obtaining current location information" refers to methods of obtaining a user's current location information using technologies such as GPS.
[1365] A "shelter" refers to a place where people can ensure their safety during an earthquake, such as a shelter or temporary evacuation site.
[1366] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[1367] "Information regarding evacuation shelters" refers to detailed information such as the name of the evacuation shelter, its address, distance from your current location, and its capacity.
[1368] "Means for notifying users of evacuation shelters on their devices" refers to means for transmitting information about evacuation shelters to users' devices.
[1369] An "evacuation zone" is an area affected by an earthquake where evacuation is necessary.
[1370] "Demand" refers to the amount of goods and services needed in an evacuation zone.
[1371] "Inventory data" refers to information about the stock of goods and services that can be supplied.
[1372] A "list of necessary supplies" is a list that shows a list of supplies needed in an evacuation area.
[1373] "Means of allowing users to select available supplies" refers to methods of allowing users to select the supplies they can provide and transmitting that information to the system.
[1374] "Information on the provision of goods" refers to detailed information (type, quantity, etc.) about the goods provided by users.
[1375] "Means for aggregating information on the provision of supplies and arranging delivery" refers to means for efficiently delivering necessary supplies based on the aggregated information on the provision of supplies.
[1376] "Map information" refers to geographical guidance information necessary for users to find their way to an evacuation site.
[1377] This invention relates to a system for the rapid evacuation guidance and supply of necessary goods during an earthquake, and consists of the interaction of a server, terminals, and users. This system makes it possible to collect earthquake information in real time, provide appropriate evacuation information to users, and rapidly supply necessary goods.
[1378] Collection of earthquake information
[1379] The server collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency. This process involves sending HTTP requests and parsing the JSON data received as responses. Specific data includes the time of the earthquake, its epicenter, and its seismic intensity. The collected data is stored in a MySQL database.
[1380] Obtaining user location information
[1381] When an earthquake occurs, the user launches a dedicated smartphone app. The device (smartphone) obtains GPS data through location services. The obtained location data (latitude and longitude) is sent to a server via Firebase and stored in a database.
[1382] Search for evacuation shelters
[1383] The server searches its database for the nearest evacuation shelter based on the user's current location information. This process uses PostGIS to calculate geographical distances. From the calculation results, it retrieves detailed information such as the name, address, latitude, and longitude of the nearest evacuation shelter.
[1384] Notification of evacuation shelter information
[1385] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. This notification includes the name and address of the evacuation shelter, as well as map information including a Google Maps link. In this way, the user can confirm the route to the appropriate evacuation shelter.
[1386] Generating a list of necessary supplies
[1387] The server matches demand and inventory data for the evacuation area and generates a list of necessary supplies. Based on inventory data retrieved from the database, it creates a list of supplies needed in the evacuation area (e.g., drinking water, blankets, emergency food, etc.) and displays it on the system's web interface.
[1388] Management and tabulation of donated goods
[1389] Users (who are outside the evacuation zone) log in and select the supplies they can provide. The selected supply information is sent to the server and stored in the database. The server aggregates the supply information provided by each user and checks whether the necessary supplies have been collected.
[1390] Delivery arrangements
[1391] The server calculates the optimal delivery route based on the aggregated supply information. Based on the calculated delivery route, it arranges for the delivery of supplies through the APIs of partner logistics companies. Finally, it notifies the supply providers and the evacuation areas of the delivery status of the supplies.
[1392] Specific example
[1393] For example, suppose an earthquake occurs in Tokyo, and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app and requests evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that a "park" evacuation shelter in Chiyoda Ward is the most suitable evacuation location and notifies user A of this information. User A clicks on the map link and evacuates while checking the route to the evacuation shelter.
[1394] Meanwhile, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[1395] Example of a prompt
[1396] "An earthquake has occurred, and users need evacuation information. Please design a system that notifies users of the optimal evacuation location and route. Additionally, please add a mechanism to provide users outside the evacuation zone with information on necessary supplies and to arrange for their delivery."
[1397] The flow of the specific processing in Example 1 will be explained using Figure 11.
[1398] Step 1:
[1399] The server collects earthquake information in real time. Specifically, it sends HTTP requests to APIs of information sources such as the Japan Meteorological Agency. The input includes the API endpoint URL and request parameters, and the output is earthquake information in JSON format. This received data contains information about the time of the earthquake, the epicenter, and the seismic intensity, which is parsed and stored in a MySQL database.
[1400] Step 2:
[1401] When an earthquake occurs, the user launches a smartphone app. The device (smartphone) obtains GPS data using location services. The input includes raw data from the GPS sensor, and the output is the latitude and longitude of the current location. This location information is sent to the server via Firebase. The server receives this data and stores it in a database.
[1402] Step 3:
[1403] The server searches for the nearest evacuation shelter from its database based on the user's current location information. Specifically, it uses PostGIS to calculate geographical distances based on the received latitude and longitude. The input includes the user's location information and database information on evacuation shelters, and the output provides the name, address, latitude, and longitude of the optimal evacuation shelter.
[1404] Step 4:
[1405] The server uses Firebase Cloud Messaging (FCM) to notify the device of the acquired evacuation shelter information. The input includes detailed information about the evacuation shelter (name, address, map link), and the output is a push notification of the evacuation shelter information sent to the user's smartphone. The notification also includes a detailed map link of the evacuation shelter, which the user can click to view the map information.
[1406] Step 5:
[1407] The server retrieves demand and inventory data for the evacuation area from a database and generates a list of necessary supplies. The input includes demand and inventory data for the evacuation area, and the output is a list of necessary supplies (e.g., drinking water, blankets, emergency food, etc.). This list is presented through the system's web interface.
[1408] Step 6:
[1409] Users (who are outside the evacuation zone) log in and select the supplies they can provide. Specifically, they enter details of the supplies they can provide via a web interface and submit them. The input includes the username, the type and quantity of supplies to be provided, and the information about the supplies provided is sent to the server and stored in the database.
[1410] Step 7:
[1411] The server checks whether all necessary supplies are available based on the aggregated supply information. Input includes supply information and required supply lists provided by each user, and output provides the total amount of supplies and a list of missing supplies. Based on this, the server calculates the optimal delivery route.
[1412] Step 8:
[1413] The server calculates the optimal delivery route and then arranges for the delivery of supplies through the API of a partner logistics company. Inputs include the delivery address, detailed information about the supplies, and optimal route information, and the output is the completion of the supply delivery arrangement. The delivery status is also monitored, and notifications are sent to the supply provider and the evacuation area.
[1414] (Application Example 1)
[1415] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1416] During an earthquake, rapid and accurate evacuation guidance is crucial. However, conventional systems are insufficient for real-time earthquake information gathering, user location acquisition, and shelter search and notification, often leading to delays in evacuation. Furthermore, the supply of necessary goods in evacuation areas may be delayed, posing a challenge in responding quickly to the needs of evacuees. In particular, rapid response is extremely important in the event of a large-scale earthquake, but conventional methods struggle to adequately achieve this.
[1417] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[1418] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for generating a list of necessary supplies based on the needs of the evacuation area using a generative model, means for notifying the user of the generated evacuation shelter and necessary supplies information, and means for generating prompt sentences for input into the generative AI model. This enables rapid and accurate evacuation guidance and the rapid supply of supplies to meet the needs of the evacuation area in the event of an earthquake.
[1419] "Earthquake information" refers to information that includes data such as the time of the earthquake, the epicenter, and the seismic intensity.
[1420] "Real-time collection" means collecting information almost immediately after an earthquake occurs.
[1421] "User's current location information" refers to information about the user's current location, identified using means such as GPS.
[1422] "Methods for searching for evacuation shelters" refers to methods for identifying the nearest evacuation shelter based on the user's current location information.
[1423] "Information regarding evacuation shelters" includes information such as the name of the evacuation shelter, its address, and its distance from your current location.
[1424] A "generative model" is an algorithm that generates the desired output based on a given set of input data.
[1425] A "list of necessary supplies" is a list of essential items generated by matching the needs of the evacuation area with inventory data.
[1426] "Information on the provision of supplies" refers to data regarding the types and quantities of supplies that can be provided.
[1427] "Delivery arrangements" refer to the procedures for ensuring that supplies are delivered quickly to designated evacuation areas.
[1428] A "generative AI model" is an artificial intelligence system designed to perform specific tasks or process data using machine learning techniques.
[1429] A "prompt statement" is an input statement to a generative AI model, in the form of instructions or questions to obtain the required output.
[1430] A system for carrying out this invention includes the following configuration.
[1431] System configuration and hardware / software used
[1432] 1. Servers: Cloud services such as AWS and Google Cloud will be used for real-time data processing and database management. MySQL and PostgreSQL will be used as databases to store earthquake information, evacuation center information, and information on the provision of supplies.
[1433] 2. Earthquake Information Collection API: Using APIs from the Japan Meteorological Agency and other sources, data such as the time of earthquake occurrence, epicenter, and seismic intensity are obtained in real time.
[1434] 3. Smartphone device: Uses an iOS or Android smartphone and obtains the user's current location information using GPS functionality. Data communication with the server is performed via internet connection and notification services.
[1435] 4. Generative AI Model: Using machine learning techniques, this model generates lists of necessary supplies based on the needs of evacuation areas and generates prompt messages. The model is built and operated using libraries such as TensorFlow and PyTorch.
[1436] Processing flow
[1437] 1. Gathering earthquake information:
[1438] The server uses an earthquake information API to acquire earthquake data in real time and stores it in a database.
[1439] 2. Obtaining the user's location information:
[1440] Smartphones use GPS functionality to obtain the user's current location and send it to a server. This location information is used to search for evacuation shelters.
[1441] 3. Searching for and notifying evacuation shelters:
[1442] The server searches its database for the nearest evacuation shelter based on the user's current location. The server then notifies the user's smartphone of the shelter's information. The notification includes the shelter's name, address, distance from the user's current location, and route information.
[1443] 4. Generating a list of necessary supplies:
[1444] The server uses a generative AI model to match the needs of the evacuation area with inventory data and generate a list of necessary supplies. This list is provided to users in other regions and serves as a basis for selecting relief supplies.
[1445] 5. Management of supply information and arrangement of delivery:
[1446] The provided supply information is compiled on a server, the optimal delivery route is calculated, and arrangements are made with logistics companies. This ensures that supplies are delivered quickly.
[1447] Specific example
[1448] For example, if an earthquake occurs in Tokyo, the system will operate as follows:
[1449] (Example of a prompt message)
[1450] During an earthquake:
[1451] User's current location: Chiyoda-ku, Tokyo
[1452] Shelter search criteria: The shelter closest to the user.
[1453] Notification content: Detailed route information to the nearest evacuation shelter and evacuation destination.
[1454] Based on this prompt, the server retrieves information about the nearest evacuation shelter, "Chiyoda Park," and notifies the user. The notification includes the message, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route." The user can click the provided link and evacuate while viewing map information to the shelter.
[1455] At the same time, users outside the evacuation zone are presented with a list of necessary supplies and can select the items they can provide and send them to the server. Based on this information, the server compiles the supplies, arranges for their delivery, and delivers them to the evacuation centers via the most optimal route.
[1456] In this way, this system enables rapid evacuation guidance and the supply of necessary goods to evacuation areas during earthquakes.
[1457] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[1458] Step 1: Gathering earthquake information
[1459] The server calls the Japan Meteorological Agency's earthquake information API to obtain real-time data such as the time of earthquake occurrence, epicenter, and seismic intensity. The obtained data is stored in a MySQL or PostgreSQL database. The input is earthquake data obtained from the earthquake information API, and the output is earthquake information stored in the database.
[1460] Step 2: Obtaining the user's location information
[1461] The device (the user's smartphone) obtains its current location information using the built-in GPS function. The obtained location information is transmitted to the server via the internet. The input is the user's current location information obtained from GPS, and the output is the location information data transmitted to the server.
[1462] Step 3: Search for an evacuation shelter
[1463] The server uses the user's current location information to search the database for the nearest evacuation shelter. This uses an algorithm that calculates distance using the location information to identify the closest shelter. The input is the user's current location information, and the output is the nearest evacuation shelter information.
[1464] Step 4: Notification of evacuation shelter information
[1465] When the server retrieves information about the nearest evacuation shelter, it sends a notification to the user's device. The notification includes the name and address of the shelter, the distance from the current location, and detailed route information. Specifically, the server sends a push notification to the device. The input is the information about the nearest evacuation shelter, and the output is the notification message sent to the user.
[1466] Step 5: Generate a list of necessary supplies
[1467] The server uses a generative AI model to generate a list of necessary supplies based on the needs and inventory data of the evacuation area. Specifically, it optimizes the supply of goods to meet the estimated needs of the evacuation area. The input is the needs data and inventory data of the evacuation area, and the output is a list of necessary supplies.
[1468] Step 6: Choosing the Provision of Supplies
[1469] Users outside the evacuation zone log into the system using a terminal and select the supplies they can provide based on the list of necessary supplies provided by the server. The selection information is sent to the server. The input is the information of the supplies selected by the user, and the output is the information of the supplies provided that is sent to the server.
[1470] Step 7: Compiling information on supply provision and arranging delivery.
[1471] The server uses the collected supply information to verify that all necessary supplies are available and calculates the optimal delivery route. It then calls the logistics provider API to arrange the actual delivery. The input is the aggregated supply information, and the output is the delivery arrangement information sent to the logistics provider.
[1472] Step 8: Notification of the list of necessary supplies and shelter information.
[1473] The server generates prompt statements for input to the AI model, uses them to generate notification messages containing information on each evacuation center and necessary supplies, and sends them to personnel and support staff in the evacuation area. For example, a prompt statement like "When an earthquake occurs: User's current location: Chiyoda-ku, Tokyo; Evacuation center search criteria: Evacuation center closest to the user; Notification content: Detailed route information to the nearest evacuation center and evacuation destination" is used. The input is the prompt statement, and the output is the generated notification message.
[1474] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[1475] This invention provides more personalized support by combining a system designed for rapid evacuation guidance and supply of necessary goods during an earthquake with an emotion engine that recognizes the user's emotions. This system consists of the interaction of a server, a terminal, and the user.
[1476] Program Overview
[1477] The following programs are executed on this system:
[1478] Collection of earthquake information
[1479] Server: Collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency, and stores various earthquake-related data (occurrence time, epicenter, seismic intensity, etc.) in a database.
[1480] Acquiring user location information and searching for evacuation shelters
[1481] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[1482] Device: Uses GPS functionality to obtain current location information and sends this information to the server.
[1483] Server: Based on the received location information, it searches the database for the nearest evacuation shelter and generates information on recommended evacuation locations.
[1484] Notification of information about evacuation shelters
[1485] Server: Notifies the user's device of information regarding recommended evacuation locations (e.g., name, address, distance, and route from the current location of the evacuation center). This notification also includes detailed map information to the evacuation center, allowing the user to head to the evacuation center based on this information.
[1486] Generating a list of necessary supplies and managing the supplies provided.
[1487] Server: Matches the needs and inventory data of the evacuation area to create a list of necessary supplies. This list is presented to users outside the affected area who are connected to the system. Users select the supplies they can provide and send that information to the server.
[1488] Tallying and arranging the delivery of donated supplies
[1489] Server: Aggregates information on the donated supplies and verifies whether all necessary supplies are available. Based on the aggregated data, it calculates the optimal delivery route and arranges for the delivery of the supplies. This ensures that necessary supplies reach evacuation areas quickly.
[1490] Support by an emotional engine
[1491] In addition to the evacuation order and supplies supply functions mentioned above, this system incorporates an emotion engine that recognizes the user's emotions, providing more personalized support.
[1492] Identifying emotions
[1493] Terminal: Acquires user voice and facial expression information and sends it to the emotion engine.
[1494] Emotion Engine: Analyzes acquired voice and facial expression information to identify the user's emotions (e.g., relief, anxiety, fear, etc.).
[1495] Customizing notification content
[1496] Server: Customizes shelter information notifications based on the emotions of identified users. For example, users with high stress levels will receive messages with more polite and calming language.
[1497] Specific example
[1498] For example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[1499] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[1500] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[1501] Thus, the present invention is a system aimed at providing rapid evacuation support and supplying necessary goods during an earthquake, and furthermore, by utilizing an emotion engine, it can provide personalized support to users.
[1502] The following describes the processing flow.
[1503] Processing related to evacuation orders
[1504] Step 1:
[1505] Server: Collects earthquake information in real time from reliable sources such as the Japan Meteorological Agency and stores various earthquake-related data (time of occurrence, epicenter, seismic intensity, etc.) in a database.
[1506] Step 2:
[1507] User: When an earthquake occurs, launch the smartphone app and request evacuation information.
[1508] Step 3:
[1509] Device: Uses GPS functionality to obtain current location information. If location information cannot be obtained, other location-determining technologies such as Wi-Fi or cellular base stations will be used to obtain location information.
[1510] Step 4:
[1511] Terminal: Sends the acquired current location information to the server.
[1512] Step 5:
[1513] Server: Based on the received location information, it searches the database for the nearest evacuation shelter. Factors such as safety, capacity, and current congestion are considered when selecting an evacuation shelter.
[1514] Step 6:
[1515] Server: Based on search results, generates appropriate shelter information for the user. This information includes the shelter's name, address, distance, and current congestion status.
[1516] Step 7:
[1517] Server: Notifies the user's terminal of the generated evacuation shelter information. It sends the message: "The nearest evacuation shelter from your current location is Chiyoda Park. Click the following link to check the route."
[1518] Step 8:
[1519] User: Receives a notification and clicks the provided link to view detailed map information to the evacuation shelter.
[1520] Step 9:
[1521] Device: Open the provided link URL to display a detailed map and navigation information to the evacuation shelter.
[1522] Processing of requests for necessary supplies
[1523] Step 1:
[1524] Users (outside the affected area): Log in to the system and check the list of necessary supplies for the evacuation area.
[1525] Step 2:
[1526] Server: Verify the user's authentication information and grant permission to log in.
[1527] Step 3:
[1528] Server: Retrieves supply request information for evacuation areas from the database, compares it with current inventory data, and generates a list of necessary supplies.
[1529] Step 4:
[1530] Server: Presents the generated list of necessary supplies to the user. The list of necessary supplies includes the specific types and quantities of supplies required in the evacuation area.
[1531] Step 5:
[1532] User: Select the supplies you can provide (e.g., 10 liters of drinking water, 5 blankets) and enter the information.
[1533] Step 6:
[1534] Terminal: Sends the entered supply provision information to the server.
[1535] Step 7:
[1536] Server: Aggregates the provided supply information and verifies that sufficient supplies are available. Furthermore, it develops the optimal delivery plan based on the provided supplies.
[1537] Step 8:
[1538] Server: Calculates the optimal delivery route and method, and arranges the delivery of goods. This process includes coordinating with logistics providers and setting delivery priorities.
[1539] Step 9:
[1540] Server: Notifies the supply provider that delivery arrangements are complete. This notification includes the scheduled delivery date and time and tracking information.
[1541] Support by an emotional engine
[1542] Processing related to emotion recognition
[1543] Step 1:
[1544] Device: Collects user voice information via microphone and captures facial expressions with a camera.
[1545] Step 2:
[1546] Terminal: Sends collected voice and facial expression information to the emotion engine.
[1547] Step 3:
[1548] Emotion Engine: Analyzes voice and facial expression information to identify the user's emotions (e.g., relief, anxiety, fear, etc.).
[1549] Step 4:
[1550] Emotion engine: Sends identified emotion information to the server.
[1551] Processing related to emotion-based notification customization
[1552] Step 1:
[1553] Server: Receives sentiment information of identified users.
[1554] Step 2:
[1555] Server: Customizes the content of evacuation shelter information notifications based on the user's emotions. For example, it generates more polite and reassuring messages for users with high stress levels.
[1556] Step 3:
[1557] Server: Sends customized notification content to the user's device. It also sends an additional message: "Don't worry, there is plenty of space and supplies at the shelter."
[1558] As a concrete example, consider a scenario where an earthquake occurs in Tokyo and user A is in Chiyoda Ward. After the earthquake, user A launches a smartphone app to request evacuation information. The device uses GPS to obtain its current location (Chiyoda Ward) and sends this information to the server. The server determines that "Chiyoda Park" is the most suitable evacuation shelter and sends a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[1559] Furthermore, the device identifies user A's face with its camera and collects their voice with its microphone. Based on this, the emotion engine identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[1560] Simultaneously, user B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation area. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and arranges for the delivery of the supplies. As a result, the necessary supplies are quickly delivered to the evacuation center in Chiyoda Ward.
[1561] Thus, this invention provides rapid evacuation support and provision of necessary supplies during earthquakes, and further enables personalized support to users by utilizing an emotion engine.
[1562] (Example 2)
[1563] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1564] During an earthquake, extremely rapid and accurate evacuation support is required. However, conventional systems have the problem of providing general and uniform evacuation information, which does not adequately consider the individual circumstances and emotional states of users. Furthermore, while rapid supply of goods is essential, conventional systems sometimes made it difficult to carry out this smoothly. To solve these problems, a system is needed that allows for more detailed responses in evacuation support and supply of goods.
[1565] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[1566] In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotion information. This enables rapid and accurate evacuation support while taking into account the emotional state of each individual user. It also enables the smooth and rapid provision of supplies necessary for evacuation support.
[1567] "Earthquake information" refers to detailed information about the occurrence of an earthquake, specifically including data such as the time of occurrence, epicenter, and seismic intensity.
[1568] "Means of real-time collection" refers to technological means for instantly acquiring earthquake information via the internet and storing it in a database.
[1569] "User's current location information" refers to the specific latitude and longitude information of the user's current location.
[1570] "Means for obtaining current location information" refers to technical means that use GPS functionality to obtain the user's current location.
[1571] "Methods for searching for evacuation shelters" refers to technical means that identify the most appropriate evacuation location based on the user's current location from a database.
[1572] "Information regarding evacuation shelters" refers to detailed data about evacuation shelters, such as their names, addresses, distances, and map information.
[1573] "Means of notification" refers to technical means of transmitting relevant information to users via smartphones or other communication devices.
[1574] "Means of recognizing emotions" refers to technological means for analyzing and identifying a user's emotional state from their voice and facial expressions.
[1575] "Emotional information" refers to data that indicates the user's emotional state (e.g., feeling safe, anxious, fearful, etc.).
[1576] "Means for customizing notification content" refers to technical means that adjust the content of messages and notifications sent based on the user's emotional information.
[1577] "Supplies" refers to basic necessities of life such as drinking water, food, and blankets that are needed in evacuation shelters.
[1578] A "list of necessary supplies" refers to a list of items that are in short supply in the evacuation area.
[1579] "Supplies that can be provided" refers to supplies that can be supplied by users outside the affected area.
[1580] "Information on the provision of supplies" refers to detailed data about the supplies that can be provided (e.g., type, quantity).
[1581] "Means for aggregating and arranging delivery" refers to technical means that aggregate the provided material information, calculate the optimal delivery route, and execute the delivery procedures for the materials.
[1582] This invention is a system aimed at rapid evacuation guidance and supply of necessary goods during an earthquake, and further provides more personalized support by recognizing the user's emotions. This system consists of the interaction of a server, terminals, and users.
[1583] Collection of earthquake information
[1584] The server collects earthquake occurrence information in real time from reliable sources such as the Japan Meteorological Agency (JMA). Using the JMA's API, it retrieves earthquake information such as the time of occurrence, epicenter, and seismic intensity, and stores this information in a database (e.g., MySQL). The server periodically executes scripts to retrieve data from the sources and update the database.
[1585] Acquiring user location information and searching for evacuation shelters
[1586] Users launch a smartphone app when an earthquake occurs to request evacuation information.
[1587] The device uses GPS functionality to obtain its current location. The acquired location information is configured to be sent to a server.
[1588] The server searches the database for the nearest evacuation shelter based on the received location information. Specifically, it uses an SQL SELECT statement to compare the user's location information with evacuation shelter data to identify the most suitable shelter.
[1589] Notification of information about evacuation shelters
[1590] The server generates information about recommended evacuation locations and notifies the user's device. Specifically, it creates a notification that includes the name, address, distance, and map information of the evacuation center, and sends it as a push notification via a smartphone app.
[1591] Generating a list of necessary supplies and managing the supplies provided.
[1592] The server matches the needs of the evacuation area with inventory data and generates a list of necessary supplies. The generated list is then presented to users outside the affected area who are connected to the system.
[1593] Users select the supplies they can provide and send that information to the server. The server stores and aggregates this information in a database.
[1594] Tallying and arranging the delivery of donated supplies
[1595] The server aggregates information on supplies submitted by users and verifies whether all necessary supplies are available. Based on the aggregated results, it calculates the optimal delivery route and arranges for the supplies to be delivered. Delivery arrangements are automated using the delivery company's API.
[1596] Support by an emotional engine
[1597] The device uses its camera and microphone to acquire the user's voice and facial expression information. The acquired information is then sent to the emotion engine.
[1598] The emotion engine analyzes acquired audio and facial expression information to identify the user's emotions. Machine learning models (e.g., TensorFlow, OpenCV) are used for emotion identification.
[1599] The server customizes evacuation notifications based on identified emotional information. For example, it sends a reassuring message to users who are feeling stressed.
[1600] Specific example
[1601] If an earthquake occurs in Tokyo and user A is in Chiyoda Ward, user A will launch a smartphone app after the earthquake to request evacuation information. The device will use GPS to obtain its current location and send this information to the server. The server will identify "Chiyoda Park" as the best evacuation shelter and send a notification to user A stating, "The closest evacuation shelter to your current location is Chiyoda Park. Click the following link to check the route."
[1602] Furthermore, the device uses its camera to identify user A's face and its microphone to collect audio. The emotion engine analyzes this information and identifies user A's emotion as "anxiety." Based on this result, the server sends an additional message: "Don't worry. There is plenty of space and supplies at the shelter."
[1603] Simultaneously, User B, who is outside the affected area, logs into the system and checks the list of necessary supplies for the evacuation zone. User B selects the supplies they can provide (e.g., 10 liters of drinking water, 5 blankets) and sends a notification to the server indicating whether they can provide them. The server compiles this information and, once the necessary supplies are gathered, calculates the optimal delivery route and arranges for delivery.
[1604] In this way, the present invention can provide users with rapid and accurate evacuation guidance and the prompt supply of necessary materials. Furthermore, by utilizing an emotion engine, it is possible to provide personalized support tailored to the individual circumstances of each user.
[1605] The flow of the specific processing in Example 2 will be explained using Figure 13.
[1606] Step 1: Gathering earthquake information
[1607] The server collects earthquake information in real time from sources such as the Japan Meteorological Agency. First, the server sends a request to the Japan Meteorological Agency's API and retrieves earthquake information returned in JSON format. This includes the time of occurrence, epicenter, and seismic intensity. The server then analyzes this data and stores it in the database using INSERT statements.
[1608] Input: Earthquake information from the Japan Meteorological Agency API
[1609] Output: Earthquake information stored in the database
[1610] Step 2: Obtain the user's current location information
[1611] When an earthquake occurs, the user launches a smartphone app to request evacuation information. The app uses the smartphone's GPS function to obtain the user's current location. The app then sends the obtained latitude and longitude information to the server's API as a POST request.
[1612] Input: Latitude and longitude information obtained via GPS
[1613] Output: Current location information sent to the server
[1614] Step 3: Search for an evacuation shelter
[1615] The server searches the database for the nearest shelter based on the received location information. First, it executes an SQL query that compares the received latitude and longitude information with the shelter data and calculates the distance. It identifies the shelter with the shortest distance and returns that information as a response.
[1616] Input: User's current location information, evacuation shelter database
[1617] Output: Information on the best evacuation shelters
[1618] Step 4: Notification of evacuation shelter information
[1619] The server generates information about recommended evacuation shelters (e.g., shelter name, address, distance, map information). This information is sent to the app as a push notification. The notification is configured to include a link to the evacuation shelter and route guidance.
[1620] Input: Information on the best evacuation shelter
[1621] Output: Push notification to user's device
[1622] Step 5: Generate a list of necessary supplies and manage the supplies provided.
[1623] The server matches the needs of the evacuation area with inventory data to create a list of necessary supplies. It retrieves needs information from the database, matches it with inventory data, and generates a list of necessary supplies. This list is presented to users outside the affected area via the app. Users select the supplies they can provide and send that information to the server.
[1624] Input: Needs information for the evacuation area, inventory data
[1625] Output: List of required supplies, information on supplies provided by users
[1626] Step 6: Tallying and arranging delivery of donated supplies
[1627] The server aggregates information on the submitted supplies. It verifies that all necessary supplies are present and uses the delivery company's API to calculate the optimal delivery route. It generates delivery labels and route information to arrange for quick delivery.
[1628] Input: Information on supplies provided by the user, delivery company API
[1629] Output: Aggregated material data, delivery labels, and route information
[1630] Step 7: User emotion recognition
[1631] The device uses its camera and microphone to capture the user's face and voice. This information is sent to an emotion engine, which performs analysis to identify the user's emotional state. Specifically, TensorFlow and OpenCV are used. The results of this analysis are then sent to a server.
[1632] Input: User's face and voice data
[1633] Output: Identified sentiment information
[1634] Step 8: Customize notification content based on emotional information
[1635] The server customizes notification content based on identified emotional information. For example, it generates and sends a more reassuring message to a user who is feeling anxious. The customized message is then sent to the user's device as a push notification.
[1636] Input: Identified sentiment information
[1637] Output: Customized notification content
[1638] (Application Example 2)
[1639] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1640] Conventional earthquake evacuation guidance systems lack sufficient capabilities to quickly and efficiently guide evacuees to safety. Furthermore, they often provide generic evacuation instructions without considering the emotional needs of evacuees, resulting in unresolved psychological burdens. Additionally, the supply of necessary goods to evacuation centers is often insufficient, leading to poor living conditions. To address these issues, real-time information gathering and evacuation guidance, along with notifications that consider the emotions of evacuees and the rapid supply of necessary goods, are essential.
[1641] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting earthquake information in real time, means for acquiring the user's current location information, means for searching for evacuation shelters based on the current location information, means for notifying the user of information regarding the evacuation shelters, means for recognizing the user's emotions, and means for customizing the notification content based on the emotions. As a result, the user can acquire earthquake information in real time, move to the nearest evacuation shelter quickly and efficiently, and receive personalized messages to reduce psychological burden and realize a safe and secure evacuation. In addition, since the delivery of supplies using autonomous vehicles is also arranged, it becomes possible to supply necessary supplies to evacuation shelters quickly and efficiently.
[1642] "Means for collecting earthquake information in real time" refers to a device or system that acquires various earthquake-related data (such as the time of occurrence, epicenter, and seismic intensity) from reliable sources in real time when an earthquake occurs and stores it in a database.
[1643] "Means for obtaining the user's current location information" refers to a device or system that accurately obtains the user's current location using GPS functionality or other location information technologies.
[1644] "Means for searching for evacuation shelters" refers to a device or system that searches for the nearest evacuation shelter based on acquired location information and identifies the most suitable evacuation location for the user.
[1645] "Means of notifying users of information regarding evacuation shelters" refers to a device or system that notifies users' terminals of detailed information such as the name, address, distance, and route from their current location to a designated evacuation shelter.
[1646] "Means of recognizing user emotions" refers to devices or systems that use sensors such as cameras and microphones to analyze a user's emotions (e.g., reassurance, anxiety, fear, etc.) from their facial expressions and voice.
[1647] "Means of customizing notification content based on emotions" refers to a device or system that personalizes the content of evacuation shelter information notifications and generates appropriate messages according to the recognized emotions of the user.
[1648] "Means for generating a list of necessary supplies" refers to a device or system that matches the needs of the evacuation area with inventory data to create a list of required supplies.
[1649] "Means for selecting available supplies" refers to a device or system that allows users connected to the system to select available supplies and transmit that information to the server.
[1650] "Means for aggregating information on the provision of goods and arranging delivery" refers to a device or system that aggregates information on the provided goods, calculates the optimal delivery route, and arranges for the delivery of the goods.
[1651] "Means of delivering supplies using autonomous vehicles" refers to a device or system that uses autonomous vehicles to efficiently and quickly deliver necessary supplies to evacuation centers.
[1652] One embodiment of this invention is an evacuation guidance and supplies supply system using autonomous vehicles. This system collects earthquake information in real time, obtains the user's current location, searches for the optimal evacuation shelter, performs sentiment analysis, and then provides customized evacuation information. It also provides rapid supplies using autonomous vehicles.
[1653] Hardware configuration
[1654] Server: Manages earthquake information and supply data, and notifies users.
[1655] Device: Includes smartphones and tablets, cameras, microphones, and GPS modules, and acquires the user's location information and emotional information.
[1656] Autonomous vehicles: Used for transporting evacuees and delivering supplies.
[1657] Software Configuration
[1658] Earthquake Information Acquisition System: Collects data from the Japan Meteorological Agency and other sources in real time.
[1659] Location information acquisition system: Acquires GPS data to determine the user's current location. 【...
Claims
1. Means for collecting earthquake information in real time, A means of obtaining the user's current location information, A means for searching for an evacuation shelter based on the aforementioned current location information, A means for notifying users of information regarding the aforementioned evacuation shelters, A system that includes this.
2. The system according to claim 1, further comprising means for providing map information for heading to the aforementioned evacuation shelter.
3. A means of matching the needs of the affected area with inventory data to generate a list of necessary supplies, A means of selecting the supplies that can be provided, A means of compiling information on the provision of supplies and arranging delivery, The system according to claim 1, further comprising:
4. The system according to claim 3, further comprising means for receiving information on supplies provided by users outside the affected area and arranging for their delivery to evacuation centers.
5. The notification means is a means for sending a message containing a link to the user. The system according to claim 1, further comprising means for the user to obtain detailed map information by clicking the link.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A