System

Abstract

A system is provided.SOLUTION: A system comprising: means for acquiring location information and information on evacuation from a user via communication means as information collecting means; storage means for storing the acquired location information and information on evacuation; calculation means for generating an appropriate evacuation plan for the user based on the stored information; and notifying means for detecting occurrence of a disaster and automatically notifying the user of the generated evacuation plan.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When a disaster occurs, it is difficult to provide users with quick and accurate evacuation information. A system that provides appropriate information is particularly needed for residents in many areas where disaster prevention preparations are inadequate. Furthermore, when multiple people, such as families or groups, are involved, it is difficult to simultaneously provide consistent evacuation instructions. The purpose of this invention is to solve these problems and provide an environment in which users can evacuate safely. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems with a system including: an information collection means for acquiring location information and evacuation information from a user via a communication means; a storage means for storing the acquired location information and evacuation information; a calculation means for generating an appropriate evacuation plan for the user based on the stored information; and a notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan. By using a means for detecting the occurrence of a disaster from an external disaster information service and further including the nearest evacuation shelter and its evacuation route based on the location information in the evacuation plan, it is possible to provide evacuation instructions optimized for each individual user. Furthermore, since it is possible to provide consistent notifications to families and groups, it is also possible to support coordinated evacuation actions by multiple people.

[0006] The "information collection means" is a function for acquiring location information and information regarding evacuation from the user via a communication means.

[0007] "Communication means" means a mechanism for sending and receiving information via the Internet or other data communications network.

[0008] "Location information" is geographical information that indicates the user's current location or a specific location.

[0009] "Evacuation information" refers to detailed information necessary for evacuation, such as the user's family composition and special needs (e.g., wheelchair use, accompanying pets).

[0010] "Storage means" means a database or other storage mechanism for storing acquired location and evacuation information.

[0011] "Computational means" refers to processing means, algorithms and software for generating an appropriate evacuation plan for a user based on the stored information.

[0012] An "evacuation plan" is a plan that indicates specific routes and methods for a user to evacuate safely.

[0013] The "notification means" is a mechanism for detecting the occurrence of a disaster and automatically distributing the generated evacuation plan to the user.

[0014] A "disaster information service" is an external service that provides real-time disaster data on earthquakes, typhoons, and other disasters.

[0015] A "shelter" is a safe place or facility designated for users to evacuate to.

[0016] An "evacuation route" refers to the optimal road or route for a user to travel to a shelter. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and users.

[0039] System configuration

[0040] server

[0041] The server is the core of the system and has the following main functions:

[0042] 1. Information collection method: Obtain location information and evacuation information from the user.

[0043] 2. Storage means: Stores the acquired information in a database.

[0044] 3. Calculation method: Based on the stored information, an evacuation plan for each user is generated.

[0045] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[0046] Terminal

[0047] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[0048] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[0049] 2. User Interface: The screen where the user enters information and checks notifications.

[0050] User

[0051] A user is an individual or group who uses the system and interacts with it through the following steps:

[0052] 1. Register in the system using a device such as a smartphone.

[0053] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[0054] 3. When a disaster occurs, take evacuation action based on the evacuation plan received.

[0055] Program processing explanation

[0056] 1. Collection of information

[0057] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[0058] 2. Generate an evacuation plan

[0059] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[0060] 3. Emergency Notification

[0061] When a disaster occurs, the server retrieves information from the disaster information service and automatically notifies users of appropriate evacuation plans based on their registered information. The notifications include evacuation shelter addresses and links to evacuation routes.

[0062] Specific examples

[0063] Example 1: Gathering information

[0064] Server: "Please tell me your address."

[0065] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0066] The server stores this information in a storage means.

[0067] Example 2: Generating an evacuation plan

[0068] The server uses the stored address information to identify the nearest evacuation shelter (e.g., Yoyogi Park) and calculates the evacuation route using a map service.

[0069] Example 3: Emergency notification

[0070] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[0071] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[0072] This allows the user to take evacuation action quickly and accurately.

[0073] As described above, the present invention provides efficient and effective evacuation assistance.

[0074] The processing flow will be explained below.

[0075] Step 1:

[0076] The server sends a message to the user through the chatbot asking, "What is your address?"

[0077] Step 2:

[0078] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[0079] Step 3:

[0080] The server stores the received address information in the "User Information" table of the database.

[0081] Step 4:

[0082] The server then sends the user a question: "Please tell us your family structure."

[0083] Step 5:

[0084] The user inputs the family composition (e.g., "husband, two children") and submits it.

[0085] Step 6:

[0086] The server similarly stores the received family composition information in the "user information" table.

[0087] Step 7:

[0088] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[0089] Step 8:

[0090] The user enters their special needs (e.g., "One pet (dog)") and submits.

[0091] Step 9:

[0092] The server stores the received special needs information in a database.

[0093] Step 10:

[0094] The server identifies the nearest evacuation shelter based on the user information. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[0095] Step 11:

[0096] The server also uses the map API to calculate the evacuation route to the identified shelter.

[0097] Step 12:

[0098] The server stores the evacuation plan (location of evacuation shelter, evacuation route, etc.) generated for each user in an "Evacuation Plan" table.

[0099] Step 13:

[0100] The server periodically acquires new disaster information from the disaster information service.

[0101] Step 14:

[0102] When the server receives new disaster information, it collects user data within the disaster-affected area and automatically sends evacuation plans to the relevant users based on that data.

[0103] Step 15:

[0104] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter and a link to the evacuation route.

[0105] Step 16:

[0106] The user checks the received message, promptly begins evacuation according to the evacuation plan, and safely evacuates.

[0107] In this way, the system collects user information at each step, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely.

[0108] Example 1

[0109] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0110] The purpose of this system is to support appropriate and rapid evacuation behavior in the event of a disaster. Conventional evacuation support systems have difficulty generating optimal evacuation plans based on individual user information, and also have limited functionality for notifying users in real time when a disaster occurs. This can lead to users being unable to take appropriate action in an emergency.

[0111] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0112] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from users via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for the notification means to send an alert with sound or vibration in the event of an emergency, and means having a user interface to display on the user's terminal. This makes it possible to automatically provide appropriate and prompt evacuation plans to individual users and send accurate notifications in real time in the event of a disaster.

[0113] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via communication.

[0114] "Communication means" refers to a means for sending and receiving data via a network such as the Internet.

[0115] "Location information" is geographical data that indicates the user's current location.

[0116] "Evacuation information" refers to information necessary for making an evacuation plan, such as the user's address, family composition, and special needs.

[0117] The "storage means" refers to a database or storage device for storing acquired information.

[0118] The "calculation means" is a means for performing calculation processing to generate an appropriate evacuation plan for each user based on the stored information.

[0119] The "notification means" is a means for automatically notifying the user of the generated evacuation plan when the occurrence of a disaster is detected.

[0120] An "alert" is a means of notifying the user of a warning by sound or vibration in the event of an emergency.

[0121] A "user interface" is a screen or operating means through which a user interacts with a system, inputs information, and checks notifications.

[0122] An "evacuation plan" is a plan for guiding evacuation actions in the event of a disaster, including the nearest evacuation facility and evacuation route for the user.

[0123] The "disaster information provision service" is a service for obtaining disaster information in real time from external organizations such as the Japan Meteorological Agency.

[0124] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and a user.

[0125] System Configuration

[0126] server

[0127] The server is the core of this system and has the following main functions:

[0128] Information gathering methods

[0129] The server asks the user for necessary information (e.g., address, family composition) through the chatbot and obtains it. This is done using a natural language processing tool (e.g., Dialogflow).

[0130] storage means

[0131] The acquired information is stored in a database, which can be a general relational database management system (RDBMS).

[0132] means of calculation

[0133] The server generates an optimal evacuation plan for each user based on the collected information. Map services (e.g., Google Maps API) are used to identify evacuation shelters and calculate evacuation routes.

[0134] Notification means

[0135] The system detects the occurrence of a disaster and automatically notifies users of the generated evacuation plan via push notification and SMS, and in the event of an emergency, alerts users via sound and vibration.

[0136] Terminal

[0137] A terminal is a device through which a user interacts with the system, typically a smartphone or a PC.

[0138] communication means

[0139] The device communicates with a server via the Internet, allowing it to send and receive information and evacuation plans.

[0140] User Interface

[0141] A screen where a user can enter information or view notifications from a server. This includes web applications and smartphone apps.

[0142] User

[0143] A user is an individual or group that uses the system.

[0144] Registration and Information

[0145] Users register with the system using a device such as a smartphone and respond to the chatbot to provide the necessary information.

[0146] Actions to take in an emergency

[0147] When a disaster occurs, evacuation actions are taken based on the evacuation plan received from the server.

[0148] Specific examples

[0149] Collection of information

[0150] Server: "Please tell me your address."

[0151] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0152] The server stores this information in a storage means.

[0153] Generate evacuation plans

[0154] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[0155] Emergency Notification

[0156] When the server detects the occurrence of an earthquake, it sends a notification to the user saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below." The device receives this notification, displays it on the screen, and simultaneously issues an alert with sound and vibration.

[0157] Prompt Sentence Examples

[0158] Here are some examples of prompts for a generative AI model (e.g., GPT-4):

[0159] "Design a system for users to obtain the optimal evacuation route in the event of a disaster. The system consists of a server with chatbot functionality, a user device for inputting information, and the user themselves. Also, use a map service API for evacuation route calculation."

[0160] As described above, the present invention provides efficient and effective evacuation assistance.

[0161] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0162] Step 1: User registration and information provision

[0163] Users use devices such as smartphones or PCs to access the system's website or application and register their information. Specifically, users follow the instructions of the chatbot to enter information such as their address, family composition, and special needs. The device then sends this information to the server via communication means.

[0164] Input: Information provided by the user through the device (e.g., address)

[0165] Data processing: The terminal converts the input information into a structured format and sends it to the server.

[0166] Output: User information sent to the server

[0167] Step 2: Save your information

[0168] The server receives the information sent from the terminal, temporarily stores it in memory, then checks the validity of the information format and items, and if there are no problems, records it in a database.

[0169] Input: User information sent from the device

[0170] Data processing: The server verifies and converts the information

[0171] Output: User information stored in the database

[0172] Step 3: Identify shelters and generate plans

[0173] The server retrieves the user's address information from the database, identifies the nearest evacuation shelter using a map service (e.g., Google Maps API), calculates the evacuation route, and generates an appropriate evacuation plan.

[0174] Input: User address information stored in the database

[0175] Data processing: Identifying the nearest evacuation shelter and calculating evacuation routes based on the user's address

[0176] Output: Generated evacuation plan (e.g., map display of evacuation route)

[0177] Step 4: Save your evacuation plan

[0178] The server stores the generated evacuation plans in a database, which allows for quick access in the event of an emergency.

[0179] Input: Generated evacuation plan

[0180] Data processing: Format conversion and storage processing of evacuation plans

[0181] Output: Evacuation plan stored in database

[0182] Step 5: Detecting the occurrence of a disaster

[0183] The server monitors disaster information services (e.g., the Japan Meteorological Agency's API) in real time, and when it detects an abnormality, it obtains information about the occurrence of a disaster.

[0184] Input: Data stream from disaster information service

[0185] Data processing: Disaster information analysis and filtering

[0186] Output: Detected disaster information

[0187] Step 6: Generate emergency notifications

[0188] Based on the detected disaster information, the server retrieves the user's evacuation plan from the database and generates a notification message, which includes the nearest evacuation shelter, evacuation route, and links.

[0189] Input: Detected disaster information and evacuation plans stored in the database

[0190] Data processing: Notification message generation

[0191] Output: The generated notification message

[0192] Step 7: Send emergency notifications

[0193] The server generates a notification message and sends it to the user's device, which receives it, displays it on the user interface, and alerts the user with sound and vibration.

[0194] Input: The generated notification message

[0195] Data processing: Message sending process

[0196] Output: Notification message display and alert on user terminal

[0197] Specific operation example

[0198] Step 1: User Registration

[0199] User: "Can you tell me your address?"

[0200] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0201] The terminal sends this information to the server.

[0202] Step 3: Generate an evacuation plan

[0203] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[0204] Step 7: Notification message

[0205] Server: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[0206] The device receives this notification, displays it on the screen, and notifies the user with an alarm sound and vibration.

[0207] (Application example 1)

[0208] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0209] Rapid and appropriate evacuation assistance in emergencies is extremely important, especially for passengers in autonomous vehicles. Conventional evacuation assistance systems require passengers to collect information and select evacuation routes themselves in the event of a disaster, which can lead to delays in evacuation behavior and misjudgments. The present invention aims to solve these problems and provide rapid and appropriate evacuation assistance to passengers in autonomous vehicles.

[0210] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0211] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for acquiring the location information and disaster information and calculating a route to the nearest evacuation shelter, and notification means for providing visual and audio evacuation instructions to passengers, thereby enabling passengers in autonomous vehicles to take swift and accurate evacuation actions in the event of a disaster.

[0212] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[0213] "Communication means" refers to a means for sending and receiving data over a network.

[0214] "Location information" is information that indicates the current physical location of a user or an autonomous vehicle.

[0215] "Evacuation information" refers to information that users and passengers will need when evacuating, including addresses and special needs.

[0216] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[0217] A "calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[0218] The "notification means" is a means for automatically notifying the user or passengers of the evacuation plan created in the event of a disaster.

[0219] The "means for detecting the occurrence of a disaster" is a means for acquiring disaster information from an external disaster information providing service.

[0220] The "nearest evacuation shelter" is the safest place to evacuate to from your current location.

[0221] The "evacuation route" is route information indicating the route that the user or passengers should take to reach the evacuation shelter.

[0222] "External disaster information services" are services that allow users to obtain the latest disaster information provided by the Japan Meteorological Agency and other public institutions.

[0223] "Visual and audio notification means" refers to means of providing evacuation instructions to passengers using displays and speakers.

[0224] A "server" is a central computing device in the system that collects, analyzes, stores, and notifies data.

[0225] The emergency evacuation support system for autonomous vehicles of the present invention is designed to provide prompt and appropriate evacuation support to passengers in the vehicle. This system consists of three main components: a server, a terminal, and a user.

[0226] System configuration

[0227] server

[0228] The server is the core of the system and has the following main functions:

[0229] 1. Information collection means: The server acquires location information and evacuation information from the user via communication means.

[0230] 2. Storage means: Stores the acquired location information and evacuation information in a database.

[0231] 3. Computational means: Generates an appropriate evacuation plan based on the stored information. This includes using map services to identify the nearest evacuation shelters and calculate evacuation routes.

[0232] 4. Notification method: When a disaster occurs, the evacuation plan will be automatically notified to the terminal.

[0233] 5. Disaster information acquisition method: Obtain the latest disaster information from external disaster information services.

[0234] 6. Evacuation route calculation method: Calculates the optimal route to the nearest evacuation shelter based on disaster information and location information.

[0235] Terminal

[0236] A terminal is a device that allows a user to interact with the system, such as a display or speaker installed inside an autonomous vehicle.

[0237] 1. Communication method: The terminal communicates with the server and receives evacuation instructions and route guidance.

[0238] 2. Notification methods: Provide visual and audio evacuation instructions to passengers.

[0239] User

[0240] A user is a passenger who uses the system and interacts with the system through the following steps:

[0241] 1. When you get into a vehicle, your location information is automatically sent to the system.

[0242] 2. When a disaster occurs, you will receive a notification from the system.

[0243] 3. Follow the notices and take action based on evacuation instructions.

[0244] Program processing

[0245] Hardware and Software

[0246] Hardware: GPS module, vehicle display, speaker.

[0247] Software: Python library, disaster information API, map service API (e.g. Google Maps API).

[0248] Data processing and calculation

[0249] 1. The server obtains location information from the GPS module.

[0250] 2. The server uses the disaster information provision API to obtain the latest disaster information.

[0251] 3. The server uses the map service API to calculate the optimal route from the current location to the nearest evacuation shelter.

[0252] 4. The device receives the notification from the server and provides evacuation instructions to passengers using the display and speaker.

[0253] Specific examples

[0254] Example 1: Obtaining location information

[0255] Server: Obtain the current location "Latitude: 35.6895, Longitude: 139.6917" from the GPS module.

[0256] Server: Stores this location information in a database.

[0257] Example 2: Obtaining disaster information

[0258] Server: Obtain information about an earthquake occurrence from the disaster information provision API.

[0259] Server: Analyzes this information and generates a corresponding evacuation plan.

[0260] Example 3: Calculating evacuation routes

[0261] Server: Uses the map service API to calculate the route from the current location to the nearest "shelter A."

[0262] Example 4: Providing evacuation instructions

[0263] Device: Receives a notification from the server and displays "Please head to shelter A. Route guidance is here."

[0264] Terminal: A voice message will be displayed through the speaker saying, "The nearest evacuation shelter is Evacuation shelter A. Please follow the instructions."

[0265] Generative AI model prompt sentence

[0266] Write a Python program that retrieves the latest disaster information, calculates the optimal route from the current location to the nearest evacuation shelter, and notifies passengers in an autonomous vehicle. It uses the Google Maps API and Weather Information API, and obtains location information from the GPS module.

[0267] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0268] Step 1:

[0269] Processing: Information gathering

[0270] Subject: Server

[0271] Operation: The server obtains the current location information from the GPS module.

[0272] Input: current vehicle location

[0273] Data processing: Obtain latitude and longitude information from the GPS and convert it into coordinate data.

[0274] Output: Location information (e.g. "Latitude: 35.6895, Longitude: 139.6917")

[0275] Specific operation: The server accesses the GPS module, obtains the current location data, and stores it in the database.

[0276] Step 2:

[0277] Processing: Acquisition of disaster information

[0278] Subject: Server

[0279] Operation: The server uses the disaster information provision API to obtain the latest disaster information.

[0280] Input: API endpoint and access key

[0281] Data processing: Analyze disaster information obtained from the API and process it into valid data.

[0282] Output: Disaster information (e.g., "Earthquake occurred")

[0283] Specific operation: The server sends a request to the API of the disaster information service, analyzes the received response, and obtains disaster information.

[0284] Step 3:

[0285] Processing: Evacuation route calculation

[0286] Subject: Server

[0287] Operation: The server uses the map service API to calculate the optimal route to the nearest evacuation shelter.

[0288] Input: Location information and disaster information

[0289] Data processing: Using location information and disaster information, request parameters are generated to calculate the optimal evacuation route.

[0290] Output: Evacuation route information (e.g., "Route to shelter A")

[0291] Specific operation: The server sends a request to the map service API, analyzes the received route guidance information, and calculates the optimal evacuation route.

[0292] Step 4:

[0293] Action: Evacuation plan notification

[0294] Subject: Terminal

[0295] Operation: The terminal notifies the passengers of the evacuation plan received from the server.

[0296] Input: Evacuation route information and evacuation shelter information

[0297] Data Processing: Converting evacuation route information into a format for visual and audio notifications.

[0298] Output: Visual and audio evacuation instructions

[0299] Specific operation: The device displays evacuation route information on the display and outputs evacuation instructions aloud from the speaker.

[0300] Step 5:

[0301] Action: User initiates action

[0302] Subject: User

[0303] Action: The user begins evacuation based on the notified evacuation plan.

[0304] Input: Evacuation instructions from terminal

[0305] Data processing: Follow the evacuation instructions and create a specific action plan.

[0306] Output: Actual evacuation behavior

[0307] Specific operation: The user follows the route guidance displayed on the display and voice instructions to head to the nearest evacuation shelter.

[0308] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0309] This invention is a system that provides evacuation support that takes into consideration the user's emotions by combining an automatic emergency distribution system for disaster prevention plans and evacuation routes with an emotion engine. This system consists of three main components: a server, a terminal, and a user.

[0310] System configuration

[0311] server

[0312] The server is the core of the system and has the following main functions:

[0313] 1. Information collection method: Obtain location information and evacuation information from the user.

[0314] 2. Storage means: Stores the acquired information in a database.

[0315] 3. Calculation method: Generate an evacuation plan for each user based on the stored information.

[0316] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[0317] 5. Emotion engine: Recognizes the user's emotional state and responds accordingly.

[0318] Terminal

[0319] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[0320] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[0321] 2. User Interface: The screen where the user enters information and checks notifications.

[0322] 3. Emotion recognition means: Recognizes emotions from the user's voice and facial expressions using the device's microphone and camera.

[0323] User

[0324] A user is an individual or group who uses the system and interacts with it through the following steps:

[0325] 1. Register in the system using a device such as a smartphone.

[0326] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[0327] 3. Use emotion recognition tools to communicate your mood and emotions to the system.

[0328] 4. When a disaster occurs, take evacuation action based on the evacuation plan received.

[0329] Program processing explanation

[0330] 1. Collection of information

[0331] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[0332] 2. Recognizing emotional states

[0333] The device uses a microphone and camera to analyze the user's voice and facial expressions and transmits the data to an emotion engine, which then recognizes the user's emotional state through voice analysis, facial expression recognition, text analysis, or a combination thereof.

[0334] 3. Generate an evacuation plan

[0335] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[0336] 4. Emotional Adjustment

[0337] The server adjusts the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds encouraging and reassuring messages to the evacuation plan.

[0338] 5. Emergency Notification

[0339] When a disaster occurs, the server obtains information from the disaster information service and automatically notifies the user of an appropriate evacuation plan based on the user's registered information and emotional state. The notification includes the address of the evacuation shelter, a link to the evacuation route, and a message according to the user's emotional state.

[0340] Specific examples

[0341] Example 1: Information gathering and emotion recognition

[0342] Server: "Please tell me your address."

[0343] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0344] The server stores this information in a storage means.

[0345] The terminal detects whether the user is nervous from their facial expression.

[0346] The emotion engine determines that the user is feeling anxious.

[0347] Example 2: Generating an evacuation plan

[0348] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map service.

[0349] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[0350] Example 3: Emergency notification

[0351] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[0352] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[0353] This allows users to take quick and accurate evacuation action, making it easier to dispel anxiety.

[0354] As described above, the present invention provides more effective evacuation assistance by recognizing and considering the user's emotional state, thereby helping the user to evacuate safely and providing a sense of mental security.

[0355] The processing flow will be explained below.

[0356] Step 1:

[0357] The server sends a message to the user through the chatbot asking, "What is your address?"

[0358] Step 2:

[0359] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[0360] Step 3:

[0361] The server stores the received address information in the "User Information" table of the database.

[0362] Step 4:

[0363] The server then sends the user a question: "Please tell us your family structure."

[0364] Step 5:

[0365] The user inputs the family composition (e.g., "husband, two children") and submits it.

[0366] Step 6:

[0367] The server similarly stores the received family composition information in the "user information" table.

[0368] Step 7:

[0369] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[0370] Step 8:

[0371] The user enters their special needs (e.g., "One pet (dog)") and submits.

[0372] Step 9:

[0373] The server stores the received special needs information in a database.

[0374] Step 10:

[0375] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends them to a server for analysis.

[0376] Step 11:

[0377] The emotion engine located in the server analyzes the received data and recognizes the user's emotional state (e.g., tension, anxiety, calmness).

[0378] Step 12:

[0379] The server identifies the nearest evacuation shelter based on the user information and the recognized emotional state. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[0380] Step 13:

[0381] The server also uses the map API to calculate the evacuation route to the identified shelter.

[0382] Step 14:

[0383] The server stores the evacuation plans generated for each user in an "Evacuation Plan" table.

[0384] Step 15:

[0385] The server adjusts parts of the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds a message to the evacuation plan such as "Don't worry, you can evacuate with your family."

[0386] Step 16:

[0387] The server periodically acquires new disaster information from the disaster information service.

[0388] Step 17:

[0389] When the server receives new disaster information, it collects user data from affected areas and automatically sends evacuation plans to the affected users based on that data.

[0390] Step 18:

[0391] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter, a link to the evacuation route, and a message that provides reassurance depending on the user's emotional state.

[0392] Step 19:

[0393] The user checks the received message and promptly begins evacuation according to the evacuation plan. During evacuation, the user can remain calm while referring to the reassuring message.

[0394] In this way, the system collects user information at each step, recognizes their emotional state, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely and reducing anxiety and fear.

[0395] Example 2

[0396] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0397] Conventional evacuation support systems only provide evacuation routes based on the user's location information, but have the problem of not taking the user's emotional state into consideration. This can lead to difficulties in smoothly carrying out evacuation actions, especially in emergencies when the user feels anxious or scared. Therefore, there is a need for a system that can take the user's emotional state into consideration and provide appropriate evacuation support according to that state.

[0398] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0399] In this invention, the server includes: an information gathering means for acquiring location information and evacuation information from the user via a communication means; a storage means for saving the acquired location information and evacuation information; a calculation means for generating an appropriate evacuation plan for the user based on the saved information; a notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan; and an emotion engine for recognizing the emotional state of the user and taking action according to that emotional state. This makes it possible to support quick and appropriate evacuation behavior while taking the user's emotional state into consideration.

[0400] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[0401] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[0402] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[0403] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[0404] An "emotion engine" is a means for recognizing the user's emotional state and responding accordingly.

[0405] The "disaster information provision service" is a service for obtaining disaster information from external sources.

[0406] A "shelter" is a facility or place where users can take refuge in the event of a disaster.

[0407] An "evacuation route" is a route that a user takes to reach a shelter.

[0408] This invention is a system that considers the emotional state of the user and provides an appropriate evacuation plan in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[0409] server

[0410] The server is the core of the system and has the following main functions:

[0411] 1. Information collection method: The server acquires location information and evacuation information from the user via communication methods. For example, it uses a chatbot function to ask the user questions about their address, family composition, etc., and stores the user's responses in a database.

[0412] 2. Storage means: The server stores the acquired location information and evacuation information in a database.

[0413] 3. Calculation method: The server generates an appropriate evacuation plan for each user based on the stored information. For example, it uses a map service (e.g., map API) to identify the nearest evacuation shelter and calculate the evacuation route.

[0414] 4. Notification method: When the server detects the occurrence of a disaster, it automatically notifies the user of the generated evacuation plan.

[0415] 5. Emotion engine: The server recognizes the user's emotional state and responds accordingly. For example, if the user is feeling anxious using the emotion engine, the server adds the phrase "Don't worry, you can evacuate with your family" to the notification message.

[0416] Terminal

[0417] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[0418] 1. Communication means: The terminal sends information to the server via the Internet and receives notifications from the server.

[0419] 2. User Interface: The device has a screen where the user can enter information and view notifications.

[0420] 3. Emotion recognition means: The device uses a microphone and camera to recognize emotions from the user's voice and facial expressions, and sends that data to the emotion engine.

[0421] User

[0422] A user is an individual or group who uses the system and interacts with it through the following steps:

[0423] 1. The user registers in the system using a device such as a smartphone.

[0424] 2. The user answers the chatbot's questions and provides the necessary information (address, family composition, special needs, etc.).

[0425] 3. The user communicates their mood and emotions to the system using emotion recognition means, such as collecting emotion data using the device's camera or microphone.

[0426] 4. When a disaster occurs, the user takes evacuation action based on the received evacuation plan.

[0427] Specific examples

[0428] Example 1: Information gathering and emotion recognition

[0429] Server: "Please tell me your address."

[0430] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0431] The server stores this information in a storage means.

[0432] The device captures the user's facial expressions with a camera and analyzes their voice with a microphone, and sends this data to an emotion engine to measure the user's emotional state.

[0433] The emotion engine determines that the user is feeling anxious.

[0434] Example 2: Generating an evacuation plan

[0435] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map API.

[0436] The notification message will include the phrase "Don't worry, you can evacuate with your family."

[0437] Example 3: Emergency notification

[0438] When the server detects an earthquake, it obtains the latest information from the disaster information service.

[0439] Notification message: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[0440] Users can receive this notification and take immediate action to evacuate by following the designated evacuation route.

[0441] As described above, the present invention can take into consideration the emotional state of the user and support prompt and appropriate evacuation behavior.

[0442] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0443] Step 1: Gather information

[0444] The server uses a chatbot to ask the user for location information and evacuation information. For example, it asks, "What is your address?" and the user answers, "1-2-3 Jinnan, Shibuya-ku, Tokyo." This information is then stored in a database.

[0445] Input: User's answer (address information, etc.)

[0446] Output: User information stored in the database

[0447] Step 2: Recognizing your emotional state

[0448] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends that data to the emotion engine. The emotion engine then uses voice analysis and facial recognition technology to recognize the user's emotional state. For example, it can determine that the user is feeling anxious based on their facial expression or voice.

[0449] Input: User data (voice, facial expressions) obtained from microphone and camera

[0450] Output: User's emotional state data

[0451] Step 3: Generate an evacuation plan

[0452] The server uses the saved user information to identify the nearest evacuation shelter using a map service API and calculates an evacuation route. For example, it identifies Yoyogi Park as the nearest evacuation shelter based on the address information and creates an evacuation route to that location.

[0453] Input: User information in the database (address)

[0454] Output: Nearest evacuation shelter and evacuation route information

[0455] Step 4: Emotional Adjustment

[0456] The server uses the user's emotional state recognized by the emotion engine to tailor the evacuation plan notification message, for example adding a message like "Don't worry, you can evacuate with your family" to a user who is feeling anxious.

[0457] Input: User emotional state data

[0458] Output: Coordinated evacuation plan notification message

[0459] Step 5: Emergency Notification

[0460] When a disaster occurs, the server obtains the latest disaster information from an external disaster information service. For example, if an earthquake occurs, the server automatically notifies the user of an evacuation plan based on the user's registered information and emotional state.

[0461] Input: Latest information from disaster information services

[0462] Output: A personalized evacuation plan notification sent to the user.

[0463] Each of these steps allows the user to evacuate quickly and safely.

[0464] (Application example 2)

[0465] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0466] Conventional evacuation assistance systems do not take into account the user's emotional state and are unable to reduce the psychological burden of evacuation behavior. Furthermore, due to confusion that arises during emergencies, evacuation routes and guidance to evacuation shelters are often not properly implemented. Furthermore, the technology for utilizing autonomous vehicles for evacuation assistance is still underdeveloped, creating a need for an integrated evacuation assistance system.

[0467] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0468] In this invention, the server includes information collection means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, emotion engine means for recognizing the emotional state of the user and taking measures according to that emotional state, and means for connecting to a control device of the autonomous vehicle and controlling the autonomous vehicle based on the evacuation plan. This enables evacuation assistance that takes into account the emotional state of the user and further enables smooth evacuation guidance using an autonomous vehicle.

[0469] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via a communication means.

[0470] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[0471] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[0472] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[0473] The "emotion engine means" is a means for recognizing the user's emotional state and taking measures according to that emotional state.

[0474] An "automated driving vehicle control device" is a device for controlling an automatically driving vehicle.

[0475] An "evacuation plan" is a plan that identifies appropriate evacuation shelters and evacuation routes based on the user's location information and the situation at the time of a disaster.

[0476] An "autonomous vehicle" is a vehicle that uses autonomous driving technology and can travel without the need for driver operation.

[0477] The "disaster information provision service" is a service that acquires disaster occurrence information from external sources.

[0478] "User's emotional state" refers to changes in the user's psychological state and emotions.

[0479] MODE FOR CARRYING OUT THE INVENTION

[0480] This invention is an automatic emergency distribution system for disaster prevention plans and evacuation routes that takes into account the user's emotional state, and also a system that provides evacuation support by integrating autonomous vehicles. This system consists of three main components: a server, a terminal, and an autonomous vehicle.

[0481] System configuration

[0482] server

[0483] The server is the core of the system and has the following main functions:

[0484] 1. Information collection method: Obtain location and evacuation information from the user, including the user's address, number of passengers, and special needs.

[0485] 2. Storage means: The acquired information is stored in a database. The acquired information includes the user's location, evacuation route, and evacuation shelter information.

[0486] 3. Calculation method: Generate an evacuation plan for each user based on the stored information. The calculation method includes a function to calculate routes taking into account traffic information and evacuation shelter information.

[0487] 4. Notification method: When a disaster occurs, evacuation plans are automatically sent to users. The notification method sends information to users' smartphones and autonomous vehicles.

[0488] 5. Emotion engine means: Recognizes the user's emotional state and takes appropriate measures based on that emotional state. The emotion engine means analyzes the user's emotions from their facial expressions and voice and generates appropriate messages.

[0489] Terminal

[0490] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[0491] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[0492] 2. User Interface: The screen where the user enters information and checks notifications.

[0493] 3. Emotion recognition: Emotions are recognized from the user's voice and facial expressions using the device's microphone and camera. Emotion recognition is performed using OpenCV and the Google Cloud Speech-to-Text API.

[0494] Autonomous vehicles

[0495] Autonomous vehicles are used to safely guide users during evacuations.

[0496] 1. Location information acquisition means: Uses a GPS module to acquire the current location.

[0497] 2. Vehicle control means: Autonomous driving is controlled based on the user's evacuation plan. Autonomous driving software (e.g., Autoware) is used for vehicle control.

[0498] 3. User interface: Using displays and voice guidance systems inside the autonomous vehicle, users will be notified of evacuation routes and messages based on their emotions.

[0499] Program processing explanation

[0500] The server first collects and stores user information. It then uses the device's camera and microphone to recognize the user's emotional state and analyzes it using an emotion engine. The server then generates an optimal evacuation plan based on the collected information and the user's emotional state. This evacuation plan is then sent to the autonomous vehicle's control system. The autonomous vehicle then guides the user safely according to the evacuation plan, notifying them of the evacuation route and emotionally sensitive messages via in-car displays and voice messages.

[0501] Specific examples

[0502] Example 1: Information gathering and emotion recognition

[0503] Server: "Please tell me your address."

[0504] User: "Address: 1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0505] The server stores this information.

[0506] The terminal detects whether the user is nervous from their facial expression.

[0507] The emotion engine determines that the user is feeling anxious.

[0508] Example 2: Generating an evacuation plan

[0509] The server identifies the nearest evacuation shelter from the address information and calculates the evacuation route.

[0510] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[0511] Example 3: Emergency notification

[0512] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[0513] "An earthquake has occurred. We are heading to the nearest evacuation shelter. Please rest assured, you can evacuate with your family."

[0514] The autonomous vehicle will follow the evacuation plan and safely guide the user to the nearest evacuation shelter.

[0515] Also, as an example of a specific prompt sentence, enter the following:

[0516] "The user's face should detect signs of tension, and their voice should detect signs of anxiety."

[0517] This allows the present invention to provide efficient and safe evacuation assistance while taking into consideration the user's emotional state and providing a sense of psychological security. By combining this with autonomous driving technology, even greater convenience and safety are ensured.

[0518] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0519] Step 1:

[0520] Information gathering

[0521] The server receives location and evacuation information from the user via communication means. This information includes the user's address, number of passengers, and special needs. For example, when a user enters "1-2-3 Jinnan, Shibuya-ku, Tokyo" through a smartphone app, the information is sent to the server. The server stores this information in a database.

[0522] Step 2:

[0523] emotion recognition

[0524] The device uses a built-in microphone and camera to capture the user's voice and facial expressions. This data is sent to the emotion engine, which uses a generative AI model to analyze the voice and recognize facial expressions. For example, if the user's facial expression shows tension or anxiety, the emotion engine will determine this as "anxiety." This result is then sent to the server.

[0525] Step 3:

[0526] Generate evacuation plans

[0527] The server generates an appropriate evacuation plan for each user based on the saved location and emotion information. Map data and traffic information are used to generate the plan, and the nearest evacuation shelter and its route are calculated. For example, Yoyogi Park is identified as the nearest evacuation shelter, and a specific evacuation route is calculated using the Google Maps API. A notification message is generated based on the calculation results and emotion information. If the emotion information is "anxiety," the notification message will include the message, "Don't worry, you can evacuate with your family."

[0528] Step 4:

[0529] notification

[0530] The server notifies the device of the generated evacuation plan and a message. The device then displays the evacuation plan to the user through a user interface. For example, when an earthquake occurs, a message is displayed saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Don't worry, you can evacuate with your family."

[0531] Step 5:

[0532] Autonomous vehicle control

[0533] The server sends the generated evacuation plan to the autonomous vehicle's control device, and the vehicle control system operates according to the plan. Specifically, the vehicle automatically begins moving along the calculated route. For example, if the nearest evacuation shelter is Yoyogi Park, the vehicle control system will use GPS data to guide the vehicle in that direction, taking into account traffic conditions along the way in real time.

[0534] Step 6:

[0535] Ongoing monitoring and adjustment

[0536] The server and device continuously monitor the user's emotional state and location, adjusting the evacuation plan as needed. For example, if the user shows strong anxiety again during the evacuation, the emotion engine will reassess in real time, and the server will generate additional messages to reassure the user.

[0537] The above is the specific processing flow of the system that realizes this application example. It shows how the hardware and software used in each step work together and what kind of data processing or data calculation is performed. This realizes efficient and safe evacuation support while taking into account the user's emotional state.

[0538] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0539] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0540] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0541] [Second embodiment]

[0542] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0543] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0544] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0545] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0546] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0547] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0548] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0549] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0550] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0551] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0552] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0553] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0554] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and users.

[0555] System configuration

[0556] server

[0557] The server is the core of the system and has the following main functions:

[0558] 1. Information collection method: Obtain location information and evacuation information from the user.

[0559] 2. Storage means: Stores the acquired information in a database.

[0560] 3. Calculation method: Based on the stored information, an evacuation plan for each user is generated.

[0561] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[0562] Terminal

[0563] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[0564] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[0565] 2. User Interface: The screen where the user enters information and checks notifications.

[0566] User

[0567] A user is an individual or group who uses the system and interacts with it through the following steps:

[0568] 1. Register in the system using a device such as a smartphone.

[0569] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[0570] 3. When a disaster occurs, take evacuation action based on the evacuation plan received.

[0571] Program processing explanation

[0572] 1. Collection of information

[0573] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[0574] 2. Generate an evacuation plan

[0575] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[0576] 3. Emergency Notification

[0577] When a disaster occurs, the server retrieves information from the disaster information service and automatically notifies users of appropriate evacuation plans based on their registered information. The notifications include evacuation shelter addresses and links to evacuation routes.

[0578] Specific examples

[0579] Example 1: Gathering information

[0580] Server: "Please tell me your address."

[0581] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0582] The server stores this information in a storage means.

[0583] Example 2: Generating an evacuation plan

[0584] The server uses the stored address information to identify the nearest evacuation shelter (e.g., Yoyogi Park) and calculates the evacuation route using a map service.

[0585] Example 3: Emergency notification

[0586] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[0587] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[0588] This allows the user to take evacuation action quickly and accurately.

[0589] As described above, the present invention provides efficient and effective evacuation assistance.

[0590] The processing flow will be explained below.

[0591] Step 1:

[0592] The server sends a message to the user through the chatbot asking, "What is your address?"

[0593] Step 2:

[0594] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[0595] Step 3:

[0596] The server stores the received address information in the "User Information" table of the database.

[0597] Step 4:

[0598] The server then sends the user a question: "Please tell us your family structure."

[0599] Step 5:

[0600] The user inputs the family composition (e.g., "husband, two children") and submits it.

[0601] Step 6:

[0602] The server similarly stores the received family composition information in the "user information" table.

[0603] Step 7:

[0604] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[0605] Step 8:

[0606] The user enters their special needs (e.g., "One pet (dog)") and submits.

[0607] Step 9:

[0608] The server stores the received special needs information in a database.

[0609] Step 10:

[0610] The server identifies the nearest evacuation shelter based on the user information. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[0611] Step 11:

[0612] The server also uses the map API to calculate the evacuation route to the identified shelter.

[0613] Step 12:

[0614] The server stores the evacuation plan (location of evacuation shelter, evacuation route, etc.) generated for each user in an "Evacuation Plan" table.

[0615] Step 13:

[0616] The server periodically acquires new disaster information from the disaster information service.

[0617] Step 14:

[0618] When the server receives new disaster information, it collects user data within the disaster-affected area and automatically sends evacuation plans to the relevant users based on that data.

[0619] Step 15:

[0620] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter and a link to the evacuation route.

[0621] Step 16:

[0622] The user checks the received message, promptly begins evacuation according to the evacuation plan, and safely evacuates.

[0623] In this way, the system collects user information at each step, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely.

[0624] Example 1

[0625] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0626] The purpose of this system is to support appropriate and rapid evacuation behavior in the event of a disaster. Conventional evacuation support systems have difficulty generating optimal evacuation plans based on individual user information, and also have limited functionality for notifying users in real time when a disaster occurs. This can lead to users being unable to take appropriate action in an emergency.

[0627] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0628] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from users via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for the notification means to send an alert with sound or vibration in the event of an emergency, and means having a user interface to display on the user's terminal. This makes it possible to automatically provide appropriate and prompt evacuation plans to individual users and send accurate notifications in real time in the event of a disaster.

[0629] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via communication.

[0630] "Communication means" refers to a means for sending and receiving data via a network such as the Internet.

[0631] "Location information" is geographical data that indicates the user's current location.

[0632] "Evacuation information" refers to information necessary for making an evacuation plan, such as the user's address, family composition, and special needs.

[0633] The "storage means" refers to a database or storage device for storing acquired information.

[0634] The "calculation means" is a means for performing calculation processing to generate an appropriate evacuation plan for each user based on the stored information.

[0635] The "notification means" is a means for automatically notifying the user of the generated evacuation plan when the occurrence of a disaster is detected.

[0636] An "alert" is a means of notifying the user of a warning by sound or vibration in the event of an emergency.

[0637] A "user interface" is a screen or operating means through which a user interacts with a system, inputs information, and checks notifications.

[0638] An "evacuation plan" is a plan for guiding evacuation actions in the event of a disaster, including the nearest evacuation facility and evacuation route for the user.

[0639] The "disaster information provision service" is a service for obtaining disaster information in real time from external organizations such as the Japan Meteorological Agency.

[0640] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and a user.

[0641] System Configuration

[0642] server

[0643] The server is the core of this system and has the following main functions:

[0644] Information gathering methods

[0645] The server asks the user for necessary information (e.g., address, family composition) through the chatbot and obtains it. This is done using a natural language processing tool (e.g., Dialogflow).

[0646] storage means

[0647] The acquired information is stored in a database, which can be a general relational database management system (RDBMS).

[0648] means of calculation

[0649] The server generates an optimal evacuation plan for each user based on the collected information. Map services (e.g., Google Maps API) are used to identify evacuation shelters and calculate evacuation routes.

[0650] Notification means

[0651] The system detects the occurrence of a disaster and automatically notifies users of the generated evacuation plan via push notification and SMS, and in the event of an emergency, alerts users via sound and vibration.

[0652] Terminal

[0653] A terminal is a device through which a user interacts with the system, typically a smartphone or a PC.

[0654] communication means

[0655] The device communicates with a server via the Internet, allowing it to send and receive information and evacuation plans.

[0656] User Interface

[0657] A screen where a user can enter information or view notifications from a server. This includes web applications and smartphone apps.

[0658] User

[0659] A user is an individual or group that uses the system.

[0660] Registration and Information

[0661] Users register with the system using a device such as a smartphone and respond to the chatbot to provide the necessary information.

[0662] Actions to take in an emergency

[0663] When a disaster occurs, evacuation actions are taken based on the evacuation plan received from the server.

[0664] Specific examples

[0665] Collection of information

[0666] Server: "Please tell me your address."

[0667] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0668] The server stores this information in a storage means.

[0669] Generate evacuation plans

[0670] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[0671] Emergency Notification

[0672] When the server detects the occurrence of an earthquake, it sends a notification to the user saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below." The device receives this notification, displays it on the screen, and simultaneously issues an alert with sound and vibration.

[0673] Prompt Sentence Examples

[0674] Here are some examples of prompts for a generative AI model (e.g., GPT-4):

[0675] "Design a system for users to obtain the optimal evacuation route in the event of a disaster. The system consists of a server with chatbot functionality, a user device for inputting information, and the user themselves. Also, use a map service API for evacuation route calculation."

[0676] As described above, the present invention provides efficient and effective evacuation assistance.

[0677] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0678] Step 1: User registration and information provision

[0679] Users use devices such as smartphones or PCs to access the system's website or application and register their information. Specifically, users follow the instructions of the chatbot to enter information such as their address, family composition, and special needs. The device then sends this information to the server via communication means.

[0680] Input: Information provided by the user through the device (e.g., address)

[0681] Data processing: The terminal converts the input information into a structured format and sends it to the server.

[0682] Output: User information sent to the server

[0683] Step 2: Save your information

[0684] The server receives the information sent from the terminal, temporarily stores it in memory, then checks the validity of the information format and items, and if there are no problems, records it in a database.

[0685] Input: User information sent from the device

[0686] Data processing: The server verifies and converts the information

[0687] Output: User information stored in the database

[0688] Step 3: Identify shelters and generate plans

[0689] The server retrieves the user's address information from the database, identifies the nearest evacuation shelter using a map service (e.g., Google Maps API), calculates the evacuation route, and generates an appropriate evacuation plan.

[0690] Input: User address information stored in the database

[0691] Data processing: Identifying the nearest evacuation shelter and calculating evacuation routes based on the user's address

[0692] Output: Generated evacuation plan (e.g., map display of evacuation route)

[0693] Step 4: Save your evacuation plan

[0694] The server stores the generated evacuation plans in a database, which allows for quick access in the event of an emergency.

[0695] Input: Generated evacuation plan

[0696] Data processing: Format conversion and storage processing of evacuation plans

[0697] Output: Evacuation plan stored in database

[0698] Step 5: Detecting the occurrence of a disaster

[0699] The server monitors disaster information services (e.g., the Japan Meteorological Agency's API) in real time, and when it detects an abnormality, it obtains information about the occurrence of a disaster.

[0700] Input: Data stream from disaster information service

[0701] Data processing: Disaster information analysis and filtering

[0702] Output: Detected disaster information

[0703] Step 6: Generate emergency notifications

[0704] Based on the detected disaster information, the server retrieves the user's evacuation plan from the database and generates a notification message, which includes the nearest evacuation shelter, evacuation route, and links.

[0705] Input: Detected disaster information and evacuation plans stored in the database

[0706] Data processing: Notification message generation

[0707] Output: The generated notification message

[0708] Step 7: Send emergency notifications

[0709] The server generates a notification message and sends it to the user's device, which receives it, displays it on the user interface, and alerts the user with sound and vibration.

[0710] Input: The generated notification message

[0711] Data processing: Message sending process

[0712] Output: Notification message display and alert on user terminal

[0713] Specific operation example

[0714] Step 1: User Registration

[0715] User: "Can you tell me your address?"

[0716] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0717] The terminal sends this information to the server.

[0718] Step 3: Generate an evacuation plan

[0719] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[0720] Step 7: Notification message

[0721] Server: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[0722] The device receives this notification, displays it on the screen, and notifies the user with an alarm sound and vibration.

[0723] (Application example 1)

[0724] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0725] Rapid and appropriate evacuation assistance in emergencies is extremely important, especially for passengers in autonomous vehicles. Conventional evacuation assistance systems require passengers to collect information and select evacuation routes themselves in the event of a disaster, which can lead to delays in evacuation behavior and misjudgments. The present invention aims to solve these problems and provide rapid and appropriate evacuation assistance to passengers in autonomous vehicles.

[0726] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0727] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for acquiring the location information and disaster information and calculating a route to the nearest evacuation shelter, and notification means for providing visual and audio evacuation instructions to passengers, thereby enabling passengers in autonomous vehicles to take swift and accurate evacuation actions in the event of a disaster.

[0728] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[0729] "Communication means" refers to a means for sending and receiving data over a network.

[0730] "Location information" is information that indicates the current physical location of a user or an autonomous vehicle.

[0731] "Evacuation information" refers to information that users and passengers will need when evacuating, including addresses and special needs.

[0732] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[0733] A "calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[0734] The "notification means" is a means for automatically notifying the user or passengers of the evacuation plan created in the event of a disaster.

[0735] The "means for detecting the occurrence of a disaster" is a means for acquiring disaster information from an external disaster information providing service.

[0736] The "nearest evacuation shelter" is the safest place to evacuate to from your current location.

[0737] The "evacuation route" is route information indicating the route that the user or passengers should take to reach the evacuation shelter.

[0738] "External disaster information services" are services that allow users to obtain the latest disaster information provided by the Japan Meteorological Agency and other public institutions.

[0739] "Visual and audio notification means" refers to means of providing evacuation instructions to passengers using displays and speakers.

[0740] A "server" is a central computing device in the system that collects, analyzes, stores, and notifies data.

[0741] The emergency evacuation support system for autonomous vehicles of the present invention is designed to provide prompt and appropriate evacuation support to passengers in the vehicle. This system consists of three main components: a server, a terminal, and a user.

[0742] System configuration

[0743] server

[0744] The server is the core of the system and has the following main functions:

[0745] 1. Information collection means: The server acquires location information and evacuation information from the user via communication means.

[0746] 2. Storage means: Stores the acquired location information and evacuation information in a database.

[0747] 3. Computational means: Generates an appropriate evacuation plan based on the stored information. This includes using map services to identify the nearest evacuation shelters and calculate evacuation routes.

[0748] 4. Notification method: When a disaster occurs, the evacuation plan will be automatically notified to the terminal.

[0749] 5. Disaster information acquisition method: Obtain the latest disaster information from external disaster information services.

[0750] 6. Evacuation route calculation method: Calculates the optimal route to the nearest evacuation shelter based on disaster information and location information.

[0751] Terminal

[0752] A terminal is a device that allows a user to interact with the system, such as a display or speaker installed inside an autonomous vehicle.

[0753] 1. Communication method: The terminal communicates with the server and receives evacuation instructions and route guidance.

[0754] 2. Notification methods: Provide visual and audio evacuation instructions to passengers.

[0755] User

[0756] A user is a passenger who uses the system and interacts with the system through the following steps:

[0757] 1. When you get into a vehicle, your location information is automatically sent to the system.

[0758] 2. When a disaster occurs, you will receive a notification from the system.

[0759] 3. Follow the notices and take action based on evacuation instructions.

[0760] Program processing

[0761] Hardware and Software

[0762] Hardware: GPS module, vehicle display, speaker.

[0763] Software: Python library, disaster information API, map service API (e.g. Google Maps API).

[0764] Data processing and calculation

[0765] 1. The server obtains location information from the GPS module.

[0766] 2. The server uses the disaster information provision API to obtain the latest disaster information.

[0767] 3. The server uses the map service API to calculate the optimal route from the current location to the nearest evacuation shelter.

[0768] 4. The device receives the notification from the server and provides evacuation instructions to passengers using the display and speaker.

[0769] Specific examples

[0770] Example 1: Obtaining location information

[0771] Server: Obtain the current location "Latitude: 35.6895, Longitude: 139.6917" from the GPS module.

[0772] Server: Stores this location information in a database.

[0773] Example 2: Obtaining disaster information

[0774] Server: Obtain information about an earthquake occurrence from the disaster information provision API.

[0775] Server: Analyzes this information and generates a corresponding evacuation plan.

[0776] Example 3: Calculating evacuation routes

[0777] Server: Uses the map service API to calculate the route from the current location to the nearest "shelter A."

[0778] Example 4: Providing evacuation instructions

[0779] Device: Receives a notification from the server and displays "Please head to shelter A. Route guidance is here."

[0780] Terminal: A voice message will be displayed through the speaker saying, "The nearest evacuation shelter is Evacuation shelter A. Please follow the instructions."

[0781] Generative AI model prompt sentence

[0782] Write a Python program that retrieves the latest disaster information, calculates the optimal route from the current location to the nearest evacuation shelter, and notifies passengers in an autonomous vehicle. It uses the Google Maps API and Weather Information API, and obtains location information from the GPS module.

[0783] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0784] Step 1:

[0785] Processing: Information gathering

[0786] Subject: Server

[0787] Operation: The server obtains the current location information from the GPS module.

[0788] Input: current vehicle location

[0789] Data processing: Obtain latitude and longitude information from the GPS and convert it into coordinate data.

[0790] Output: Location information (e.g. "Latitude: 35.6895, Longitude: 139.6917")

[0791] Specific operation: The server accesses the GPS module, obtains the current location data, and stores it in the database.

[0792] Step 2:

[0793] Processing: Acquisition of disaster information

[0794] Subject: Server

[0795] Operation: The server uses the disaster information provision API to obtain the latest disaster information.

[0796] Input: API endpoint and access key

[0797] Data processing: Analyze disaster information obtained from the API and process it into valid data.

[0798] Output: Disaster information (e.g., "Earthquake occurred")

[0799] Specific operation: The server sends a request to the API of the disaster information service, analyzes the received response, and obtains disaster information.

[0800] Step 3:

[0801] Processing: Evacuation route calculation

[0802] Subject: Server

[0803] Operation: The server uses the map service API to calculate the optimal route to the nearest evacuation shelter.

[0804] Input: Location information and disaster information

[0805] Data processing: Using location information and disaster information, request parameters are generated to calculate the optimal evacuation route.

[0806] Output: Evacuation route information (e.g., "Route to shelter A")

[0807] Specific operation: The server sends a request to the map service API, analyzes the received route guidance information, and calculates the optimal evacuation route.

[0808] Step 4:

[0809] Action: Evacuation plan notification

[0810] Subject: Terminal

[0811] Operation: The terminal notifies the passengers of the evacuation plan received from the server.

[0812] Input: Evacuation route information and evacuation shelter information

[0813] Data Processing: Converting evacuation route information into a format for visual and audio notifications.

[0814] Output: Visual and audio evacuation instructions

[0815] Specific operation: The device displays evacuation route information on the display and outputs evacuation instructions aloud from the speaker.

[0816] Step 5:

[0817] Action: User initiates action

[0818] Subject: User

[0819] Action: The user begins evacuation based on the notified evacuation plan.

[0820] Input: Evacuation instructions from terminal

[0821] Data processing: Follow the evacuation instructions and create a specific action plan.

[0822] Output: Actual evacuation behavior

[0823] Specific operation: The user follows the route guidance displayed on the display and voice instructions to head to the nearest evacuation shelter.

[0824] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0825] This invention is a system that provides evacuation support that takes into consideration the user's emotions by combining an automatic emergency distribution system for disaster prevention plans and evacuation routes with an emotion engine. This system consists of three main components: a server, a terminal, and a user.

[0826] System configuration

[0827] server

[0828] The server is the core of the system and has the following main functions:

[0829] 1. Information collection method: Obtain location information and evacuation information from the user.

[0830] 2. Storage means: Stores the acquired information in a database.

[0831] 3. Calculation method: Generate an evacuation plan for each user based on the stored information.

[0832] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[0833] 5. Emotion engine: Recognizes the user's emotional state and responds accordingly.

[0834] Terminal

[0835] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[0836] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[0837] 2. User Interface: The screen where the user enters information and checks notifications.

[0838] 3. Emotion recognition means: Recognizes emotions from the user's voice and facial expressions using the device's microphone and camera.

[0839] User

[0840] A user is an individual or group who uses the system and interacts with it through the following steps:

[0841] 1. Register in the system using a device such as a smartphone.

[0842] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[0843] 3. Use emotion recognition tools to communicate your mood and emotions to the system.

[0844] 4. When a disaster occurs, take evacuation action based on the evacuation plan received.

[0845] Program processing explanation

[0846] 1. Collection of information

[0847] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[0848] 2. Recognizing emotional states

[0849] The device uses a microphone and camera to analyze the user's voice and facial expressions and transmits the data to an emotion engine, which then recognizes the user's emotional state through voice analysis, facial expression recognition, text analysis, or a combination thereof.

[0850] 3. Generate an evacuation plan

[0851] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[0852] 4. Emotional Adjustment

[0853] The server adjusts the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds encouraging and reassuring messages to the evacuation plan.

[0854] 5. Emergency Notification

[0855] When a disaster occurs, the server obtains information from the disaster information service and automatically notifies the user of an appropriate evacuation plan based on the user's registered information and emotional state. The notification includes the address of the evacuation shelter, a link to the evacuation route, and a message according to the user's emotional state.

[0856] Specific examples

[0857] Example 1: Information gathering and emotion recognition

[0858] Server: "Please tell me your address."

[0859] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0860] The server stores this information in a storage means.

[0861] The terminal detects whether the user is nervous from their facial expression.

[0862] The emotion engine determines that the user is feeling anxious.

[0863] Example 2: Generating an evacuation plan

[0864] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map service.

[0865] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[0866] Example 3: Emergency notification

[0867] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[0868] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[0869] This allows users to take quick and accurate evacuation action, making it easier to dispel anxiety.

[0870] As described above, the present invention provides more effective evacuation assistance by recognizing and considering the user's emotional state, thereby helping the user to evacuate safely and providing a sense of mental security.

[0871] The processing flow will be explained below.

[0872] Step 1:

[0873] The server sends a message to the user through the chatbot asking, "What is your address?"

[0874] Step 2:

[0875] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[0876] Step 3:

[0877] The server stores the received address information in the "User Information" table of the database.

[0878] Step 4:

[0879] The server then sends the user a question: "Please tell us your family structure."

[0880] Step 5:

[0881] The user inputs the family composition (e.g., "husband, two children") and submits it.

[0882] Step 6:

[0883] The server similarly stores the received family composition information in the "user information" table.

[0884] Step 7:

[0885] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[0886] Step 8:

[0887] The user enters their special needs (e.g., "One pet (dog)") and submits.

[0888] Step 9:

[0889] The server stores the received special needs information in a database.

[0890] Step 10:

[0891] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends them to a server for analysis.

[0892] Step 11:

[0893] The emotion engine located in the server analyzes the received data and recognizes the user's emotional state (e.g., tension, anxiety, calmness).

[0894] Step 12:

[0895] The server identifies the nearest evacuation shelter based on the user information and the recognized emotional state. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[0896] Step 13:

[0897] The server also uses the map API to calculate the evacuation route to the identified shelter.

[0898] Step 14:

[0899] The server stores the evacuation plans generated for each user in an "Evacuation Plan" table.

[0900] Step 15:

[0901] The server adjusts parts of the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds a message to the evacuation plan such as "Don't worry, you can evacuate with your family."

[0902] Step 16:

[0903] The server periodically acquires new disaster information from the disaster information service.

[0904] Step 17:

[0905] When the server receives new disaster information, it collects user data from affected areas and automatically sends evacuation plans to the affected users based on that data.

[0906] Step 18:

[0907] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter, a link to the evacuation route, and a message that provides reassurance depending on the user's emotional state.

[0908] Step 19:

[0909] The user checks the received message and promptly begins evacuation according to the evacuation plan. During evacuation, the user can remain calm while referring to the reassuring message.

[0910] In this way, the system collects user information at each step, recognizes their emotional state, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely and reducing anxiety and fear.

[0911] Example 2

[0912] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0913] Conventional evacuation support systems only provide evacuation routes based on the user's location information, but have the problem of not taking the user's emotional state into consideration. This can lead to difficulties in smoothly carrying out evacuation actions, especially in emergencies when the user feels anxious or scared. Therefore, there is a need for a system that can take the user's emotional state into consideration and provide appropriate evacuation support according to that state.

[0914] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0915] In this invention, the server includes: an information gathering means for acquiring location information and evacuation information from the user via a communication means; a storage means for saving the acquired location information and evacuation information; a calculation means for generating an appropriate evacuation plan for the user based on the saved information; a notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan; and an emotion engine for recognizing the emotional state of the user and taking action according to that emotional state. This makes it possible to support quick and appropriate evacuation behavior while taking the user's emotional state into consideration.

[0916] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[0917] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[0918] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[0919] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[0920] An "emotion engine" is a means for recognizing the user's emotional state and responding accordingly.

[0921] The "disaster information provision service" is a service for obtaining disaster information from external sources.

[0922] A "shelter" is a facility or place where users can take refuge in the event of a disaster.

[0923] An "evacuation route" is a route that a user takes to reach a shelter.

[0924] This invention is a system that considers the emotional state of the user and provides an appropriate evacuation plan in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[0925] server

[0926] The server is the core of the system and has the following main functions:

[0927] 1. Information collection method: The server acquires location information and evacuation information from the user via communication methods. For example, it uses a chatbot function to ask the user questions about their address, family composition, etc., and stores the user's responses in a database.

[0928] 2. Storage means: The server stores the acquired location information and evacuation information in a database.

[0929] 3. Calculation method: The server generates an appropriate evacuation plan for each user based on the stored information. For example, it uses a map service (e.g., map API) to identify the nearest evacuation shelter and calculate the evacuation route.

[0930] 4. Notification method: When the server detects the occurrence of a disaster, it automatically notifies the user of the generated evacuation plan.

[0931] 5. Emotion engine: The server recognizes the user's emotional state and responds accordingly. For example, if the user is feeling anxious using the emotion engine, the server adds the phrase "Don't worry, you can evacuate with your family" to the notification message.

[0932] Terminal

[0933] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[0934] 1. Communication means: The terminal sends information to the server via the Internet and receives notifications from the server.

[0935] 2. User Interface: The device has a screen where the user can enter information and view notifications.

[0936] 3. Emotion recognition means: The device uses a microphone and camera to recognize emotions from the user's voice and facial expressions, and sends that data to the emotion engine.

[0937] User

[0938] A user is an individual or group who uses the system and interacts with it through the following steps:

[0939] 1. The user registers in the system using a device such as a smartphone.

[0940] 2. The user answers the chatbot's questions and provides the necessary information (address, family composition, special needs, etc.).

[0941] 3. The user communicates their mood and emotions to the system using emotion recognition means, such as collecting emotion data using the device's camera or microphone.

[0942] 4. When a disaster occurs, the user takes evacuation action based on the received evacuation plan.

[0943] Specific examples

[0944] Example 1: Information gathering and emotion recognition

[0945] Server: "Please tell me your address."

[0946] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[0947] The server stores this information in a storage means.

[0948] The device captures the user's facial expressions with a camera and analyzes their voice with a microphone, and sends this data to an emotion engine to measure the user's emotional state.

[0949] The emotion engine determines that the user is feeling anxious.

[0950] Example 2: Generating an evacuation plan

[0951] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map API.

[0952] The notification message will include the phrase "Don't worry, you can evacuate with your family."

[0953] Example 3: Emergency notification

[0954] When the server detects an earthquake, it obtains the latest information from the disaster information service.

[0955] Notification message: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[0956] Users can receive this notification and take immediate action to evacuate by following the designated evacuation route.

[0957] As described above, the present invention can take into consideration the emotional state of the user and support prompt and appropriate evacuation behavior.

[0958] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0959] Step 1: Gather information

[0960] The server uses a chatbot to ask the user for location information and evacuation information. For example, it asks, "What is your address?" and the user answers, "1-2-3 Jinnan, Shibuya-ku, Tokyo." This information is then stored in a database.

[0961] Input: User's answer (address information, etc.)

[0962] Output: User information stored in the database

[0963] Step 2: Recognizing your emotional state

[0964] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends that data to the emotion engine. The emotion engine then uses voice analysis and facial recognition technology to recognize the user's emotional state. For example, it can determine that the user is feeling anxious based on their facial expression or voice.

[0965] Input: User data (voice, facial expressions) obtained from microphone and camera

[0966] Output: User's emotional state data

[0967] Step 3: Generate an evacuation plan

[0968] The server uses the saved user information to identify the nearest evacuation shelter using a map service API and calculates an evacuation route. For example, it identifies Yoyogi Park as the nearest evacuation shelter based on the address information and creates an evacuation route to that location.

[0969] Input: User information in the database (address)

[0970] Output: Nearest evacuation shelter and evacuation route information

[0971] Step 4: Emotional Adjustment

[0972] The server uses the user's emotional state recognized by the emotion engine to tailor the evacuation plan notification message, for example adding a message like "Don't worry, you can evacuate with your family" to a user who is feeling anxious.

[0973] Input: User emotional state data

[0974] Output: Coordinated evacuation plan notification message

[0975] Step 5: Emergency Notification

[0976] When a disaster occurs, the server obtains the latest disaster information from an external disaster information service. For example, if an earthquake occurs, the server automatically notifies the user of an evacuation plan based on the user's registered information and emotional state.

[0977] Input: Latest information from disaster information services

[0978] Output: A personalized evacuation plan notification sent to the user.

[0979] Each of these steps allows the user to evacuate quickly and safely.

[0980] (Application example 2)

[0981] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0982] Conventional evacuation assistance systems do not take into account the user's emotional state and are unable to reduce the psychological burden of evacuation behavior. Furthermore, due to confusion that arises during emergencies, evacuation routes and guidance to evacuation shelters are often not properly implemented. Furthermore, the technology for utilizing autonomous vehicles for evacuation assistance is still underdeveloped, creating a need for an integrated evacuation assistance system.

[0983] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0984] In this invention, the server includes information collection means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, emotion engine means for recognizing the emotional state of the user and taking measures according to that emotional state, and means for connecting to a control device of the autonomous vehicle and controlling the autonomous vehicle based on the evacuation plan. This enables evacuation assistance that takes into account the emotional state of the user and further enables smooth evacuation guidance using an autonomous vehicle.

[0985] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via a communication means.

[0986] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[0987] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[0988] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[0989] The "emotion engine means" is a means for recognizing the user's emotional state and taking measures according to that emotional state.

[0990] An "automated driving vehicle control device" is a device for controlling an automatically driving vehicle.

[0991] An "evacuation plan" is a plan that identifies appropriate evacuation shelters and evacuation routes based on the user's location information and the situation at the time of a disaster.

[0992] An "autonomous vehicle" is a vehicle that uses autonomous driving technology and can travel without the need for driver operation.

[0993] The "disaster information provision service" is a service that acquires disaster occurrence information from external sources.

[0994] "User's emotional state" refers to changes in the user's psychological state and emotions.

[0995] MODE FOR CARRYING OUT THE INVENTION

[0996] This invention is an automatic emergency distribution system for disaster prevention plans and evacuation routes that takes into account the user's emotional state, and also a system that provides evacuation support by integrating autonomous vehicles. This system consists of three main components: a server, a terminal, and an autonomous vehicle.

[0997] System configuration

[0998] server

[0999] The server is the core of the system and has the following main functions:

[1000] 1. Information collection method: Obtain location and evacuation information from the user, including the user's address, number of passengers, and special needs.

[1001] 2. Storage means: The acquired information is stored in a database. The acquired information includes the user's location, evacuation route, and evacuation shelter information.

[1002] 3. Calculation method: Generate an evacuation plan for each user based on the stored information. The calculation method includes a function to calculate routes taking into account traffic information and evacuation shelter information.

[1003] 4. Notification method: When a disaster occurs, evacuation plans are automatically sent to users. The notification method sends information to users' smartphones and autonomous vehicles.

[1004] 5. Emotion engine means: Recognizes the user's emotional state and takes appropriate measures based on that emotional state. The emotion engine means analyzes the user's emotions from their facial expressions and voice and generates appropriate messages.

[1005] Terminal

[1006] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1007] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[1008] 2. User Interface: The screen where the user enters information and checks notifications.

[1009] 3. Emotion recognition: Emotions are recognized from the user's voice and facial expressions using the device's microphone and camera. Emotion recognition is performed using OpenCV and the Google Cloud Speech-to-Text API.

[1010] Autonomous vehicles

[1011] Autonomous vehicles are used to safely guide users during evacuations.

[1012] 1. Location information acquisition means: Uses a GPS module to acquire the current location.

[1013] 2. Vehicle control means: Autonomous driving is controlled based on the user's evacuation plan. Autonomous driving software (e.g., Autoware) is used for vehicle control.

[1014] 3. User interface: Using displays and voice guidance systems inside the autonomous vehicle, users will be notified of evacuation routes and messages based on their emotions.

[1015] Program processing explanation

[1016] The server first collects and stores user information. It then uses the device's camera and microphone to recognize the user's emotional state and analyzes it using an emotion engine. The server then generates an optimal evacuation plan based on the collected information and the user's emotional state. This evacuation plan is then sent to the autonomous vehicle's control system. The autonomous vehicle then guides the user safely according to the evacuation plan, notifying them of the evacuation route and emotionally sensitive messages via in-car displays and voice messages.

[1017] Specific examples

[1018] Example 1: Information gathering and emotion recognition

[1019] Server: "Please tell me your address."

[1020] User: "Address: 1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1021] The server stores this information.

[1022] The terminal detects whether the user is nervous from their facial expression.

[1023] The emotion engine determines that the user is feeling anxious.

[1024] Example 2: Generating an evacuation plan

[1025] The server identifies the nearest evacuation shelter from the address information and calculates the evacuation route.

[1026] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[1027] Example 3: Emergency notification

[1028] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[1029] "An earthquake has occurred. We are heading to the nearest evacuation shelter. Please rest assured, you can evacuate with your family."

[1030] The autonomous vehicle will follow the evacuation plan and safely guide the user to the nearest evacuation shelter.

[1031] Also, as an example of a specific prompt sentence, enter the following:

[1032] "The user's face should detect signs of tension, and their voice should detect signs of anxiety."

[1033] This allows the present invention to provide efficient and safe evacuation assistance while taking into consideration the user's emotional state and providing a sense of psychological security. By combining this with autonomous driving technology, even greater convenience and safety are ensured.

[1034] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1035] Step 1:

[1036] Information gathering

[1037] The server receives location and evacuation information from the user via communication means. This information includes the user's address, number of passengers, and special needs. For example, when a user enters "1-2-3 Jinnan, Shibuya-ku, Tokyo" through a smartphone app, the information is sent to the server. The server stores this information in a database.

[1038] Step 2:

[1039] emotion recognition

[1040] The device uses a built-in microphone and camera to capture the user's voice and facial expressions. This data is sent to the emotion engine, which uses a generative AI model to analyze the voice and recognize facial expressions. For example, if the user's facial expression shows tension or anxiety, the emotion engine will determine this as "anxiety." This result is then sent to the server.

[1041] Step 3:

[1042] Generate evacuation plans

[1043] The server generates an appropriate evacuation plan for each user based on the saved location and emotion information. Map data and traffic information are used to generate the plan, and the nearest evacuation shelter and its route are calculated. For example, Yoyogi Park is identified as the nearest evacuation shelter, and a specific evacuation route is calculated using the Google Maps API. A notification message is generated based on the calculation results and emotion information. If the emotion information is "anxiety," the notification message will include the message, "Don't worry, you can evacuate with your family."

[1044] Step 4:

[1045] notification

[1046] The server notifies the device of the generated evacuation plan and a message. The device then displays the evacuation plan to the user through a user interface. For example, when an earthquake occurs, a message is displayed saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Don't worry, you can evacuate with your family."

[1047] Step 5:

[1048] Autonomous vehicle control

[1049] The server sends the generated evacuation plan to the autonomous vehicle's control device, and the vehicle control system operates according to the plan. Specifically, the vehicle automatically begins moving along the calculated route. For example, if the nearest evacuation shelter is Yoyogi Park, the vehicle control system will use GPS data to guide the vehicle in that direction, taking into account traffic conditions along the way in real time.

[1050] Step 6:

[1051] Ongoing monitoring and adjustment

[1052] The server and device continuously monitor the user's emotional state and location, adjusting the evacuation plan as needed. For example, if the user shows strong anxiety again during the evacuation, the emotion engine will reassess in real time, and the server will generate additional messages to reassure the user.

[1053] The above is the specific processing flow of the system that realizes this application example. It shows how the hardware and software used in each step work together and what kind of data processing or data calculation is performed. This realizes efficient and safe evacuation support while taking into account the user's emotional state.

[1054] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1055] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1056] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1057] [Third embodiment]

[1058] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1059] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1060] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1061] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1062] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1063] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1064] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1065] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1066] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1067] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1068] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1069] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1070] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and users.

[1071] System configuration

[1072] server

[1073] The server is the core of the system and has the following main functions:

[1074] 1. Information collection method: Obtain location information and evacuation information from the user.

[1075] 2. Storage means: Stores the acquired information in a database.

[1076] 3. Calculation method: Based on the stored information, an evacuation plan for each user is generated.

[1077] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[1078] Terminal

[1079] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1080] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[1081] 2. User Interface: The screen where the user enters information and checks notifications.

[1082] User

[1083] A user is an individual or group who uses the system and interacts with it through the following steps:

[1084] 1. Register in the system using a device such as a smartphone.

[1085] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[1086] 3. When a disaster occurs, take evacuation action based on the evacuation plan received.

[1087] Program processing explanation

[1088] 1. Collection of information

[1089] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[1090] 2. Generate an evacuation plan

[1091] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[1092] 3. Emergency Notification

[1093] When a disaster occurs, the server retrieves information from the disaster information service and automatically notifies users of appropriate evacuation plans based on their registered information. The notifications include evacuation shelter addresses and links to evacuation routes.

[1094] Specific examples

[1095] Example 1: Gathering information

[1096] Server: "Please tell me your address."

[1097] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1098] The server stores this information in a storage means.

[1099] Example 2: Generating an evacuation plan

[1100] The server uses the stored address information to identify the nearest evacuation shelter (e.g., Yoyogi Park) and calculates the evacuation route using a map service.

[1101] Example 3: Emergency notification

[1102] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[1103] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[1104] This allows the user to take evacuation action quickly and accurately.

[1105] As described above, the present invention provides efficient and effective evacuation assistance.

[1106] The processing flow will be explained below.

[1107] Step 1:

[1108] The server sends a message to the user through the chatbot asking, "What is your address?"

[1109] Step 2:

[1110] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[1111] Step 3:

[1112] The server stores the received address information in the "User Information" table of the database.

[1113] Step 4:

[1114] The server then sends the user a question: "Please tell us your family structure."

[1115] Step 5:

[1116] The user inputs the family composition (e.g., "husband, two children") and submits it.

[1117] Step 6:

[1118] The server similarly stores the received family composition information in the "user information" table.

[1119] Step 7:

[1120] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[1121] Step 8:

[1122] The user enters their special needs (e.g., "One pet (dog)") and submits.

[1123] Step 9:

[1124] The server stores the received special needs information in a database.

[1125] Step 10:

[1126] The server identifies the nearest evacuation shelter based on the user information. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[1127] Step 11:

[1128] The server also uses the map API to calculate the evacuation route to the identified shelter.

[1129] Step 12:

[1130] The server stores the evacuation plan (location of evacuation shelter, evacuation route, etc.) generated for each user in an "Evacuation Plan" table.

[1131] Step 13:

[1132] The server periodically acquires new disaster information from the disaster information service.

[1133] Step 14:

[1134] When the server receives new disaster information, it collects user data within the disaster-affected area and automatically sends evacuation plans to the relevant users based on that data.

[1135] Step 15:

[1136] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter and a link to the evacuation route.

[1137] Step 16:

[1138] The user checks the received message, promptly begins evacuation according to the evacuation plan, and safely evacuates.

[1139] In this way, the system collects user information at each step, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely.

[1140] Example 1

[1141] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1142] The purpose of this system is to support appropriate and rapid evacuation behavior in the event of a disaster. Conventional evacuation support systems have difficulty generating optimal evacuation plans based on individual user information, and also have limited functionality for notifying users in real time when a disaster occurs. This can lead to users being unable to take appropriate action in an emergency.

[1143] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1144] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from users via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for the notification means to send an alert with sound or vibration in the event of an emergency, and means having a user interface to display on the user's terminal. This makes it possible to automatically provide appropriate and prompt evacuation plans to individual users and send accurate notifications in real time in the event of a disaster.

[1145] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via communication.

[1146] "Communication means" refers to a means for sending and receiving data via a network such as the Internet.

[1147] "Location information" is geographical data that indicates the user's current location.

[1148] "Evacuation information" refers to information necessary for making an evacuation plan, such as the user's address, family composition, and special needs.

[1149] The "storage means" refers to a database or storage device for storing acquired information.

[1150] The "calculation means" is a means for performing calculation processing to generate an appropriate evacuation plan for each user based on the stored information.

[1151] The "notification means" is a means for automatically notifying the user of the generated evacuation plan when the occurrence of a disaster is detected.

[1152] An "alert" is a means of notifying the user of a warning by sound or vibration in the event of an emergency.

[1153] A "user interface" is a screen or operating means through which a user interacts with a system, inputs information, and checks notifications.

[1154] An "evacuation plan" is a plan for guiding evacuation actions in the event of a disaster, including the nearest evacuation facility and evacuation route for the user.

[1155] The "disaster information provision service" is a service for obtaining disaster information in real time from external organizations such as the Japan Meteorological Agency.

[1156] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and a user.

[1157] System Configuration

[1158] server

[1159] The server is the core of this system and has the following main functions:

[1160] Information gathering methods

[1161] The server asks the user for necessary information (e.g., address, family composition) through the chatbot and obtains it. This is done using a natural language processing tool (e.g., Dialogflow).

[1162] storage means

[1163] The acquired information is stored in a database, which can be a general relational database management system (RDBMS).

[1164] means of calculation

[1165] The server generates an optimal evacuation plan for each user based on the collected information. Map services (e.g., Google Maps API) are used to identify evacuation shelters and calculate evacuation routes.

[1166] Notification means

[1167] The system detects the occurrence of a disaster and automatically notifies users of the generated evacuation plan via push notification and SMS, and in the event of an emergency, alerts users via sound and vibration.

[1168] Terminal

[1169] A terminal is a device through which a user interacts with the system, typically a smartphone or a PC.

[1170] communication means

[1171] The device communicates with a server via the Internet, allowing it to send and receive information and evacuation plans.

[1172] User Interface

[1173] A screen where a user can enter information or view notifications from a server. This includes web applications and smartphone apps.

[1174] User

[1175] A user is an individual or group that uses the system.

[1176] Registration and Information

[1177] Users register with the system using a device such as a smartphone and respond to the chatbot to provide the necessary information.

[1178] Actions to take in an emergency

[1179] When a disaster occurs, evacuation actions are taken based on the evacuation plan received from the server.

[1180] Specific examples

[1181] Collection of information

[1182] Server: "Please tell me your address."

[1183] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1184] The server stores this information in a storage means.

[1185] Generate evacuation plans

[1186] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[1187] Emergency Notification

[1188] When the server detects the occurrence of an earthquake, it sends a notification to the user saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below." The device receives this notification, displays it on the screen, and simultaneously issues an alert with sound and vibration.

[1189] Prompt Sentence Examples

[1190] Here are some examples of prompts for a generative AI model (e.g., GPT-4):

[1191] "Design a system for users to obtain the optimal evacuation route in the event of a disaster. The system consists of a server with chatbot functionality, a user device for inputting information, and the user themselves. Also, use a map service API for evacuation route calculation."

[1192] As described above, the present invention provides efficient and effective evacuation assistance.

[1193] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1194] Step 1: User registration and information provision

[1195] Users use devices such as smartphones or PCs to access the system's website or application and register their information. Specifically, users follow the instructions of the chatbot to enter information such as their address, family composition, and special needs. The device then sends this information to the server via communication means.

[1196] Input: Information provided by the user through the device (e.g., address)

[1197] Data processing: The terminal converts the input information into a structured format and sends it to the server.

[1198] Output: User information sent to the server

[1199] Step 2: Save your information

[1200] The server receives the information sent from the terminal, temporarily stores it in memory, then checks the validity of the information format and items, and if there are no problems, records it in a database.

[1201] Input: User information sent from the device

[1202] Data processing: The server verifies and converts the information

[1203] Output: User information stored in the database

[1204] Step 3: Identify shelters and generate plans

[1205] The server retrieves the user's address information from the database, identifies the nearest evacuation shelter using a map service (e.g., Google Maps API), calculates the evacuation route, and generates an appropriate evacuation plan.

[1206] Input: User address information stored in the database

[1207] Data processing: Identifying the nearest evacuation shelter and calculating evacuation routes based on the user's address

[1208] Output: Generated evacuation plan (e.g., map display of evacuation route)

[1209] Step 4: Save your evacuation plan

[1210] The server stores the generated evacuation plans in a database, which allows for quick access in the event of an emergency.

[1211] Input: Generated evacuation plan

[1212] Data processing: Format conversion and storage processing of evacuation plans

[1213] Output: Evacuation plan stored in database

[1214] Step 5: Detecting the occurrence of a disaster

[1215] The server monitors disaster information services (e.g., the Japan Meteorological Agency's API) in real time, and when it detects an abnormality, it obtains information about the occurrence of a disaster.

[1216] Input: Data stream from disaster information service

[1217] Data processing: Disaster information analysis and filtering

[1218] Output: Detected disaster information

[1219] Step 6: Generate emergency notifications

[1220] Based on the detected disaster information, the server retrieves the user's evacuation plan from the database and generates a notification message, which includes the nearest evacuation shelter, evacuation route, and links.

[1221] Input: Detected disaster information and evacuation plans stored in the database

[1222] Data processing: Notification message generation

[1223] Output: The generated notification message

[1224] Step 7: Send emergency notifications

[1225] The server generates a notification message and sends it to the user's device, which receives it, displays it on the user interface, and alerts the user with sound and vibration.

[1226] Input: The generated notification message

[1227] Data processing: Message sending process

[1228] Output: Notification message display and alert on user terminal

[1229] Specific operation example

[1230] Step 1: User Registration

[1231] User: "Can you tell me your address?"

[1232] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1233] The terminal sends this information to the server.

[1234] Step 3: Generate an evacuation plan

[1235] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[1236] Step 7: Notification message

[1237] Server: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[1238] The device receives this notification, displays it on the screen, and notifies the user with an alarm sound and vibration.

[1239] (Application example 1)

[1240] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1241] Rapid and appropriate evacuation assistance in emergencies is extremely important, especially for passengers in autonomous vehicles. Conventional evacuation assistance systems require passengers to collect information and select evacuation routes themselves in the event of a disaster, which can lead to delays in evacuation behavior and misjudgments. The present invention aims to solve these problems and provide rapid and appropriate evacuation assistance to passengers in autonomous vehicles.

[1242] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1243] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for acquiring the location information and disaster information and calculating a route to the nearest evacuation shelter, and notification means for providing visual and audio evacuation instructions to passengers, thereby enabling passengers in autonomous vehicles to take swift and accurate evacuation actions in the event of a disaster.

[1244] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[1245] "Communication means" refers to a means for sending and receiving data over a network.

[1246] "Location information" is information that indicates the current physical location of a user or an autonomous vehicle.

[1247] "Evacuation information" refers to information that users and passengers will need when evacuating, including addresses and special needs.

[1248] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[1249] A "calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[1250] The "notification means" is a means for automatically notifying the user or passengers of the evacuation plan created in the event of a disaster.

[1251] The "means for detecting the occurrence of a disaster" is a means for acquiring disaster information from an external disaster information providing service.

[1252] The "nearest evacuation shelter" is the safest place to evacuate to from your current location.

[1253] The "evacuation route" is route information indicating the route that the user or passengers should take to reach the evacuation shelter.

[1254] "External disaster information services" are services that allow users to obtain the latest disaster information provided by the Japan Meteorological Agency and other public institutions.

[1255] "Visual and audio notification means" refers to means of providing evacuation instructions to passengers using displays and speakers.

[1256] A "server" is a central computing device in the system that collects, analyzes, stores, and notifies data.

[1257] The emergency evacuation support system for autonomous vehicles of the present invention is designed to provide prompt and appropriate evacuation support to passengers in the vehicle. This system consists of three main components: a server, a terminal, and a user.

[1258] System configuration

[1259] server

[1260] The server is the core of the system and has the following main functions:

[1261] 1. Information collection means: The server acquires location information and evacuation information from the user via communication means.

[1262] 2. Storage means: Stores the acquired location information and evacuation information in a database.

[1263] 3. Computational means: Generates an appropriate evacuation plan based on the stored information. This includes using map services to identify the nearest evacuation shelters and calculate evacuation routes.

[1264] 4. Notification method: When a disaster occurs, the evacuation plan will be automatically notified to the terminal.

[1265] 5. Disaster information acquisition method: Obtain the latest disaster information from external disaster information services.

[1266] 6. Evacuation route calculation method: Calculates the optimal route to the nearest evacuation shelter based on disaster information and location information.

[1267] Terminal

[1268] A terminal is a device that allows a user to interact with the system, such as a display or speaker installed inside an autonomous vehicle.

[1269] 1. Communication method: The terminal communicates with the server and receives evacuation instructions and route guidance.

[1270] 2. Notification methods: Provide visual and audio evacuation instructions to passengers.

[1271] User

[1272] A user is a passenger who uses the system and interacts with the system through the following steps:

[1273] 1. When you get into a vehicle, your location information is automatically sent to the system.

[1274] 2. When a disaster occurs, you will receive a notification from the system.

[1275] 3. Follow the notices and take action based on evacuation instructions.

[1276] Program processing

[1277] Hardware and Software

[1278] Hardware: GPS module, vehicle display, speaker.

[1279] Software: Python library, disaster information API, map service API (e.g. Google Maps API).

[1280] Data processing and calculation

[1281] 1. The server obtains location information from the GPS module.

[1282] 2. The server uses the disaster information provision API to obtain the latest disaster information.

[1283] 3. The server uses the map service API to calculate the optimal route from the current location to the nearest evacuation shelter.

[1284] 4. The device receives the notification from the server and provides evacuation instructions to passengers using the display and speaker.

[1285] Specific examples

[1286] Example 1: Obtaining location information

[1287] Server: Obtain the current location "Latitude: 35.6895, Longitude: 139.6917" from the GPS module.

[1288] Server: Stores this location information in a database.

[1289] Example 2: Obtaining disaster information

[1290] Server: Obtain information about an earthquake occurrence from the disaster information provision API.

[1291] Server: Analyzes this information and generates a corresponding evacuation plan.

[1292] Example 3: Calculating evacuation routes

[1293] Server: Uses the map service API to calculate the route from the current location to the nearest "shelter A."

[1294] Example 4: Providing evacuation instructions

[1295] Device: Receives a notification from the server and displays "Please head to shelter A. Route guidance is here."

[1296] Terminal: A voice message will be displayed through the speaker saying, "The nearest evacuation shelter is Evacuation shelter A. Please follow the instructions."

[1297] Generative AI model prompt sentence

[1298] Write a Python program that retrieves the latest disaster information, calculates the optimal route from the current location to the nearest evacuation shelter, and notifies passengers in an autonomous vehicle. It uses the Google Maps API and Weather Information API, and obtains location information from the GPS module.

[1299] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1300] Step 1:

[1301] Processing: Information gathering

[1302] Subject: Server

[1303] Operation: The server obtains the current location information from the GPS module.

[1304] Input: current vehicle location

[1305] Data processing: Obtain latitude and longitude information from the GPS and convert it into coordinate data.

[1306] Output: Location information (e.g. "Latitude: 35.6895, Longitude: 139.6917")

[1307] Specific operation: The server accesses the GPS module, obtains the current location data, and stores it in the database.

[1308] Step 2:

[1309] Processing: Acquisition of disaster information

[1310] Subject: Server

[1311] Operation: The server uses the disaster information provision API to obtain the latest disaster information.

[1312] Input: API endpoint and access key

[1313] Data processing: Analyze disaster information obtained from the API and process it into valid data.

[1314] Output: Disaster information (e.g., "Earthquake occurred")

[1315] Specific operation: The server sends a request to the API of the disaster information service, analyzes the received response, and obtains disaster information.

[1316] Step 3:

[1317] Processing: Evacuation route calculation

[1318] Subject: Server

[1319] Operation: The server uses the map service API to calculate the optimal route to the nearest evacuation shelter.

[1320] Input: Location information and disaster information

[1321] Data processing: Using location information and disaster information, request parameters are generated to calculate the optimal evacuation route.

[1322] Output: Evacuation route information (e.g., "Route to shelter A")

[1323] Specific operation: The server sends a request to the map service API, analyzes the received route guidance information, and calculates the optimal evacuation route.

[1324] Step 4:

[1325] Action: Evacuation plan notification

[1326] Subject: Terminal

[1327] Operation: The terminal notifies the passengers of the evacuation plan received from the server.

[1328] Input: Evacuation route information and evacuation shelter information

[1329] Data Processing: Converting evacuation route information into a format for visual and audio notifications.

[1330] Output: Visual and audio evacuation instructions

[1331] Specific operation: The device displays evacuation route information on the display and outputs evacuation instructions aloud from the speaker.

[1332] Step 5:

[1333] Action: User initiates action

[1334] Subject: User

[1335] Action: The user begins evacuation based on the notified evacuation plan.

[1336] Input: Evacuation instructions from terminal

[1337] Data processing: Follow the evacuation instructions and create a specific action plan.

[1338] Output: Actual evacuation behavior

[1339] Specific operation: The user follows the route guidance displayed on the display and voice instructions to head to the nearest evacuation shelter.

[1340] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1341] This invention is a system that provides evacuation support that takes into consideration the user's emotions by combining an automatic emergency distribution system for disaster prevention plans and evacuation routes with an emotion engine. This system consists of three main components: a server, a terminal, and a user.

[1342] System configuration

[1343] server

[1344] The server is the core of the system and has the following main functions:

[1345] 1. Information collection method: Obtain location information and evacuation information from the user.

[1346] 2. Storage means: Stores the acquired information in a database.

[1347] 3. Calculation method: Generate an evacuation plan for each user based on the stored information.

[1348] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[1349] 5. Emotion engine: Recognizes the user's emotional state and responds accordingly.

[1350] Terminal

[1351] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1352] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[1353] 2. User Interface: The screen where the user enters information and checks notifications.

[1354] 3. Emotion recognition means: Recognizes emotions from the user's voice and facial expressions using the device's microphone and camera.

[1355] User

[1356] A user is an individual or group who uses the system and interacts with it through the following steps:

[1357] 1. Register in the system using a device such as a smartphone.

[1358] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[1359] 3. Use emotion recognition tools to communicate your mood and emotions to the system.

[1360] 4. When a disaster occurs, take evacuation action based on the evacuation plan received.

[1361] Program processing explanation

[1362] 1. Collection of information

[1363] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[1364] 2. Recognizing emotional states

[1365] The device uses a microphone and camera to analyze the user's voice and facial expressions and transmits the data to an emotion engine, which then recognizes the user's emotional state through voice analysis, facial expression recognition, text analysis, or a combination thereof.

[1366] 3. Generate an evacuation plan

[1367] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[1368] 4. Emotional Adjustment

[1369] The server adjusts the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds encouraging and reassuring messages to the evacuation plan.

[1370] 5. Emergency Notification

[1371] When a disaster occurs, the server obtains information from the disaster information service and automatically notifies the user of an appropriate evacuation plan based on the user's registered information and emotional state. The notification includes the address of the evacuation shelter, a link to the evacuation route, and a message according to the user's emotional state.

[1372] Specific examples

[1373] Example 1: Information gathering and emotion recognition

[1374] Server: "Please tell me your address."

[1375] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1376] The server stores this information in a storage means.

[1377] The terminal detects whether the user is nervous from their facial expression.

[1378] The emotion engine determines that the user is feeling anxious.

[1379] Example 2: Generating an evacuation plan

[1380] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map service.

[1381] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[1382] Example 3: Emergency notification

[1383] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[1384] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[1385] This allows users to take quick and accurate evacuation action, making it easier to dispel anxiety.

[1386] As described above, the present invention provides more effective evacuation assistance by recognizing and considering the user's emotional state, thereby helping the user to evacuate safely and providing a sense of mental security.

[1387] The processing flow will be explained below.

[1388] Step 1:

[1389] The server sends a message to the user through the chatbot asking, "What is your address?"

[1390] Step 2:

[1391] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[1392] Step 3:

[1393] The server stores the received address information in the "User Information" table of the database.

[1394] Step 4:

[1395] The server then sends the user a question: "Please tell us your family structure."

[1396] Step 5:

[1397] The user inputs the family composition (e.g., "husband, two children") and submits it.

[1398] Step 6:

[1399] The server similarly stores the received family composition information in the "user information" table.

[1400] Step 7:

[1401] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[1402] Step 8:

[1403] The user enters their special needs (e.g., "One pet (dog)") and submits.

[1404] Step 9:

[1405] The server stores the received special needs information in a database.

[1406] Step 10:

[1407] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends them to a server for analysis.

[1408] Step 11:

[1409] The emotion engine located in the server analyzes the received data and recognizes the user's emotional state (e.g., tension, anxiety, calmness).

[1410] Step 12:

[1411] The server identifies the nearest evacuation shelter based on the user information and the recognized emotional state. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[1412] Step 13:

[1413] The server also uses the map API to calculate the evacuation route to the identified shelter.

[1414] Step 14:

[1415] The server stores the evacuation plans generated for each user in an "Evacuation Plan" table.

[1416] Step 15:

[1417] The server adjusts parts of the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds a message to the evacuation plan such as "Don't worry, you can evacuate with your family."

[1418] Step 16:

[1419] The server periodically acquires new disaster information from the disaster information service.

[1420] Step 17:

[1421] When the server receives new disaster information, it collects user data from affected areas and automatically sends evacuation plans to the affected users based on that data.

[1422] Step 18:

[1423] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter, a link to the evacuation route, and a message that provides reassurance depending on the user's emotional state.

[1424] Step 19:

[1425] The user checks the received message and promptly begins evacuation according to the evacuation plan. During evacuation, the user can remain calm while referring to the reassuring message.

[1426] In this way, the system collects user information at each step, recognizes their emotional state, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely and reducing anxiety and fear.

[1427] Example 2

[1428] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1429] Conventional evacuation support systems only provide evacuation routes based on the user's location information, but have the problem of not taking the user's emotional state into consideration. This can lead to difficulties in smoothly carrying out evacuation actions, especially in emergencies when the user feels anxious or scared. Therefore, there is a need for a system that can take the user's emotional state into consideration and provide appropriate evacuation support according to that state.

[1430] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1431] In this invention, the server includes: an information gathering means for acquiring location information and evacuation information from the user via a communication means; a storage means for saving the acquired location information and evacuation information; a calculation means for generating an appropriate evacuation plan for the user based on the saved information; a notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan; and an emotion engine for recognizing the emotional state of the user and taking action according to that emotional state. This makes it possible to support quick and appropriate evacuation behavior while taking the user's emotional state into consideration.

[1432] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[1433] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[1434] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[1435] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[1436] An "emotion engine" is a means for recognizing the user's emotional state and responding accordingly.

[1437] The "disaster information provision service" is a service for obtaining disaster information from external sources.

[1438] A "shelter" is a facility or place where users can take refuge in the event of a disaster.

[1439] An "evacuation route" is a route that a user takes to reach a shelter.

[1440] This invention is a system that considers the emotional state of the user and provides an appropriate evacuation plan in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[1441] server

[1442] The server is the core of the system and has the following main functions:

[1443] 1. Information collection method: The server acquires location information and evacuation information from the user via communication methods. For example, it uses a chatbot function to ask the user questions about their address, family composition, etc., and stores the user's responses in a database.

[1444] 2. Storage means: The server stores the acquired location information and evacuation information in a database.

[1445] 3. Calculation method: The server generates an appropriate evacuation plan for each user based on the stored information. For example, it uses a map service (e.g., map API) to identify the nearest evacuation shelter and calculate the evacuation route.

[1446] 4. Notification method: When the server detects the occurrence of a disaster, it automatically notifies the user of the generated evacuation plan.

[1447] 5. Emotion engine: The server recognizes the user's emotional state and responds accordingly. For example, if the user is feeling anxious using the emotion engine, the server adds the phrase "Don't worry, you can evacuate with your family" to the notification message.

[1448] Terminal

[1449] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1450] 1. Communication means: The terminal sends information to the server via the Internet and receives notifications from the server.

[1451] 2. User Interface: The device has a screen where the user can enter information and view notifications.

[1452] 3. Emotion recognition means: The device uses a microphone and camera to recognize emotions from the user's voice and facial expressions, and sends that data to the emotion engine.

[1453] User

[1454] A user is an individual or group who uses the system and interacts with it through the following steps:

[1455] 1. The user registers in the system using a device such as a smartphone.

[1456] 2. The user answers the chatbot's questions and provides the necessary information (address, family composition, special needs, etc.).

[1457] 3. The user communicates their mood and emotions to the system using emotion recognition means, such as collecting emotion data using the device's camera or microphone.

[1458] 4. When a disaster occurs, the user takes evacuation action based on the received evacuation plan.

[1459] Specific examples

[1460] Example 1: Information gathering and emotion recognition

[1461] Server: "Please tell me your address."

[1462] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1463] The server stores this information in a storage means.

[1464] The device captures the user's facial expressions with a camera and analyzes their voice with a microphone, and sends this data to an emotion engine to measure the user's emotional state.

[1465] The emotion engine determines that the user is feeling anxious.

[1466] Example 2: Generating an evacuation plan

[1467] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map API.

[1468] The notification message will include the phrase "Don't worry, you can evacuate with your family."

[1469] Example 3: Emergency notification

[1470] When the server detects an earthquake, it obtains the latest information from the disaster information service.

[1471] Notification message: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[1472] Users can receive this notification and take immediate action to evacuate by following the designated evacuation route.

[1473] As described above, the present invention can take into consideration the emotional state of the user and support prompt and appropriate evacuation behavior.

[1474] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1475] Step 1: Gather information

[1476] The server uses a chatbot to ask the user for location information and evacuation information. For example, it asks, "What is your address?" and the user answers, "1-2-3 Jinnan, Shibuya-ku, Tokyo." This information is then stored in a database.

[1477] Input: User's answer (address information, etc.)

[1478] Output: User information stored in the database

[1479] Step 2: Recognizing your emotional state

[1480] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends that data to the emotion engine. The emotion engine then uses voice analysis and facial recognition technology to recognize the user's emotional state. For example, it can determine that the user is feeling anxious based on their facial expression or voice.

[1481] Input: User data (voice, facial expressions) obtained from microphone and camera

[1482] Output: User's emotional state data

[1483] Step 3: Generate an evacuation plan

[1484] The server uses the saved user information to identify the nearest evacuation shelter using a map service API and calculates an evacuation route. For example, it identifies Yoyogi Park as the nearest evacuation shelter based on the address information and creates an evacuation route to that location.

[1485] Input: User information in the database (address)

[1486] Output: Nearest evacuation shelter and evacuation route information

[1487] Step 4: Emotional Adjustment

[1488] The server uses the user's emotional state recognized by the emotion engine to tailor the evacuation plan notification message, for example adding a message like "Don't worry, you can evacuate with your family" to a user who is feeling anxious.

[1489] Input: User emotional state data

[1490] Output: Coordinated evacuation plan notification message

[1491] Step 5: Emergency Notification

[1492] When a disaster occurs, the server obtains the latest disaster information from an external disaster information service. For example, if an earthquake occurs, the server automatically notifies the user of an evacuation plan based on the user's registered information and emotional state.

[1493] Input: Latest information from disaster information services

[1494] Output: A personalized evacuation plan notification sent to the user.

[1495] Each of these steps allows the user to evacuate quickly and safely.

[1496] (Application example 2)

[1497] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1498] Conventional evacuation assistance systems do not take into account the user's emotional state and are unable to reduce the psychological burden of evacuation behavior. Furthermore, due to confusion that arises during emergencies, evacuation routes and guidance to evacuation shelters are often not properly implemented. Furthermore, the technology for utilizing autonomous vehicles for evacuation assistance is still underdeveloped, creating a need for an integrated evacuation assistance system.

[1499] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1500] In this invention, the server includes information collection means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, emotion engine means for recognizing the emotional state of the user and taking measures according to that emotional state, and means for connecting to a control device of the autonomous vehicle and controlling the autonomous vehicle based on the evacuation plan. This enables evacuation assistance that takes into account the emotional state of the user and further enables smooth evacuation guidance using an autonomous vehicle.

[1501] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via a communication means.

[1502] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[1503] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[1504] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[1505] The "emotion engine means" is a means for recognizing the user's emotional state and taking measures according to that emotional state.

[1506] An "automated driving vehicle control device" is a device for controlling an automatically driving vehicle.

[1507] An "evacuation plan" is a plan that identifies appropriate evacuation shelters and evacuation routes based on the user's location information and the situation at the time of a disaster.

[1508] An "autonomous vehicle" is a vehicle that uses autonomous driving technology and can travel without the need for driver operation.

[1509] The "disaster information provision service" is a service that acquires disaster occurrence information from external sources.

[1510] "User's emotional state" refers to changes in the user's psychological state and emotions.

[1511] MODE FOR CARRYING OUT THE INVENTION

[1512] This invention is an automatic emergency distribution system for disaster prevention plans and evacuation routes that takes into account the user's emotional state, and also a system that provides evacuation support by integrating autonomous vehicles. This system consists of three main components: a server, a terminal, and an autonomous vehicle.

[1513] System configuration

[1514] server

[1515] The server is the core of the system and has the following main functions:

[1516] 1. Information collection method: Obtain location and evacuation information from the user, including the user's address, number of passengers, and special needs.

[1517] 2. Storage means: The acquired information is stored in a database. The acquired information includes the user's location, evacuation route, and evacuation shelter information.

[1518] 3. Calculation method: Generate an evacuation plan for each user based on the stored information. The calculation method includes a function to calculate routes taking into account traffic information and evacuation shelter information.

[1519] 4. Notification method: When a disaster occurs, evacuation plans are automatically sent to users. The notification method sends information to users' smartphones and autonomous vehicles.

[1520] 5. Emotion engine means: Recognizes the user's emotional state and takes appropriate measures based on that emotional state. The emotion engine means analyzes the user's emotions from their facial expressions and voice and generates appropriate messages.

[1521] Terminal

[1522] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1523] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[1524] 2. User Interface: The screen where the user enters information and checks notifications.

[1525] 3. Emotion recognition: Emotions are recognized from the user's voice and facial expressions using the device's microphone and camera. Emotion recognition is performed using OpenCV and the Google Cloud Speech-to-Text API.

[1526] Autonomous vehicles

[1527] Autonomous vehicles are used to safely guide users during evacuations.

[1528] 1. Location information acquisition means: Uses a GPS module to acquire the current location.

[1529] 2. Vehicle control means: Autonomous driving is controlled based on the user's evacuation plan. Autonomous driving software (e.g., Autoware) is used for vehicle control.

[1530] 3. User interface: Using displays and voice guidance systems inside the autonomous vehicle, users will be notified of evacuation routes and messages based on their emotions.

[1531] Program processing explanation

[1532] The server first collects and stores user information. It then uses the device's camera and microphone to recognize the user's emotional state and analyzes it using an emotion engine. The server then generates an optimal evacuation plan based on the collected information and the user's emotional state. This evacuation plan is then sent to the autonomous vehicle's control system. The autonomous vehicle then guides the user safely according to the evacuation plan, notifying them of the evacuation route and emotionally sensitive messages via in-car displays and voice messages.

[1533] Specific examples

[1534] Example 1: Information gathering and emotion recognition

[1535] Server: "Please tell me your address."

[1536] User: "Address: 1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1537] The server stores this information.

[1538] The terminal detects whether the user is nervous from their facial expression.

[1539] The emotion engine determines that the user is feeling anxious.

[1540] Example 2: Generating an evacuation plan

[1541] The server identifies the nearest evacuation shelter from the address information and calculates the evacuation route.

[1542] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[1543] Example 3: Emergency notification

[1544] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[1545] "An earthquake has occurred. We are heading to the nearest evacuation shelter. Please rest assured, you can evacuate with your family."

[1546] The autonomous vehicle will follow the evacuation plan and safely guide the user to the nearest evacuation shelter.

[1547] Also, as an example of a specific prompt sentence, enter the following:

[1548] "The user's face should detect signs of tension, and their voice should detect signs of anxiety."

[1549] This allows the present invention to provide efficient and safe evacuation assistance while taking into consideration the user's emotional state and providing a sense of psychological security. By combining this with autonomous driving technology, even greater convenience and safety are ensured.

[1550] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1551] Step 1:

[1552] Information gathering

[1553] The server receives location and evacuation information from the user via communication means. This information includes the user's address, number of passengers, and special needs. For example, when a user enters "1-2-3 Jinnan, Shibuya-ku, Tokyo" through a smartphone app, the information is sent to the server. The server stores this information in a database.

[1554] Step 2:

[1555] emotion recognition

[1556] The device uses a built-in microphone and camera to capture the user's voice and facial expressions. This data is sent to the emotion engine, which uses a generative AI model to analyze the voice and recognize facial expressions. For example, if the user's facial expression shows tension or anxiety, the emotion engine will determine this as "anxiety." This result is then sent to the server.

[1557] Step 3:

[1558] Generate evacuation plans

[1559] The server generates an appropriate evacuation plan for each user based on the saved location and emotion information. Map data and traffic information are used to generate the plan, and the nearest evacuation shelter and its route are calculated. For example, Yoyogi Park is identified as the nearest evacuation shelter, and a specific evacuation route is calculated using the Google Maps API. A notification message is generated based on the calculation results and emotion information. If the emotion information is "anxiety," the notification message will include the message, "Don't worry, you can evacuate with your family."

[1560] Step 4:

[1561] notification

[1562] The server notifies the device of the generated evacuation plan and a message. The device then displays the evacuation plan to the user through a user interface. For example, when an earthquake occurs, a message is displayed saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Don't worry, you can evacuate with your family."

[1563] Step 5:

[1564] Autonomous vehicle control

[1565] The server sends the generated evacuation plan to the autonomous vehicle's control device, and the vehicle control system operates according to the plan. Specifically, the vehicle automatically begins moving along the calculated route. For example, if the nearest evacuation shelter is Yoyogi Park, the vehicle control system will use GPS data to guide the vehicle in that direction, taking into account traffic conditions along the way in real time.

[1566] Step 6:

[1567] Ongoing monitoring and adjustment

[1568] The server and device continuously monitor the user's emotional state and location, adjusting the evacuation plan as needed. For example, if the user shows strong anxiety again during the evacuation, the emotion engine will reassess in real time, and the server will generate additional messages to reassure the user.

[1569] The above is the specific processing flow of the system that realizes this application example. It shows how the hardware and software used in each step work together and what kind of data processing or data calculation is performed. This realizes efficient and safe evacuation support while taking into account the user's emotional state.

[1570] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1571] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1572] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1573] [Fourth embodiment]

[1574] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1575] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1576] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1577] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1578] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1579] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1580] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1581] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1582] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1583] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1584] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1585] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1586] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1587] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and users.

[1588] System configuration

[1589] server

[1590] The server is the core of the system and has the following main functions:

[1591] 1. Information collection method: Obtain location information and evacuation information from the user.

[1592] 2. Storage means: Stores the acquired information in a database.

[1593] 3. Calculation method: Based on the stored information, an evacuation plan for each user is generated.

[1594] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[1595] Terminal

[1596] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1597] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[1598] 2. User Interface: The screen where the user enters information and checks notifications.

[1599] User

[1600] A user is an individual or group who uses the system and interacts with it through the following steps:

[1601] 1. Register in the system using a device such as a smartphone.

[1602] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[1603] 3. When a disaster occurs, take evacuation action based on the evacuation plan received.

[1604] Program processing explanation

[1605] 1. Collection of information

[1606] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[1607] 2. Generate an evacuation plan

[1608] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[1609] 3. Emergency Notification

[1610] When a disaster occurs, the server retrieves information from the disaster information service and automatically notifies users of appropriate evacuation plans based on their registered information. The notifications include evacuation shelter addresses and links to evacuation routes.

[1611] Specific examples

[1612] Example 1: Gathering information

[1613] Server: "Please tell me your address."

[1614] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1615] The server stores this information in a storage means.

[1616] Example 2: Generating an evacuation plan

[1617] The server uses the stored address information to identify the nearest evacuation shelter (e.g., Yoyogi Park) and calculates the evacuation route using a map service.

[1618] Example 3: Emergency notification

[1619] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[1620] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[1621] This allows the user to take evacuation action quickly and accurately.

[1622] As described above, the present invention provides efficient and effective evacuation assistance.

[1623] The processing flow will be explained below.

[1624] Step 1:

[1625] The server sends a message to the user through the chatbot asking, "What is your address?"

[1626] Step 2:

[1627] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[1628] Step 3:

[1629] The server stores the received address information in the "User Information" table of the database.

[1630] Step 4:

[1631] The server then sends the user a question: "Please tell us your family structure."

[1632] Step 5:

[1633] The user inputs the family composition (e.g., "husband, two children") and submits it.

[1634] Step 6:

[1635] The server similarly stores the received family composition information in the "user information" table.

[1636] Step 7:

[1637] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[1638] Step 8:

[1639] The user enters their special needs (e.g., "One pet (dog)") and submits.

[1640] Step 9:

[1641] The server stores the received special needs information in a database.

[1642] Step 10:

[1643] The server identifies the nearest evacuation shelter based on the user information. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[1644] Step 11:

[1645] The server also uses the map API to calculate the evacuation route to the identified shelter.

[1646] Step 12:

[1647] The server stores the evacuation plan (location of evacuation shelter, evacuation route, etc.) generated for each user in an "Evacuation Plan" table.

[1648] Step 13:

[1649] The server periodically acquires new disaster information from the disaster information service.

[1650] Step 14:

[1651] When the server receives new disaster information, it collects user data within the disaster-affected area and automatically sends evacuation plans to the relevant users based on that data.

[1652] Step 15:

[1653] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter and a link to the evacuation route.

[1654] Step 16:

[1655] The user checks the received message, promptly begins evacuation according to the evacuation plan, and safely evacuates.

[1656] In this way, the system collects user information at each step, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely.

[1657] Example 1

[1658] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1659] The purpose of this system is to support appropriate and rapid evacuation behavior in the event of a disaster. Conventional evacuation support systems have difficulty generating optimal evacuation plans based on individual user information, and also have limited functionality for notifying users in real time when a disaster occurs. This can lead to users being unable to take appropriate action in an emergency.

[1660] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1661] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from users via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for the notification means to send an alert with sound or vibration in the event of an emergency, and means having a user interface to display on the user's terminal. This makes it possible to automatically provide appropriate and prompt evacuation plans to individual users and send accurate notifications in real time in the event of a disaster.

[1662] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via communication.

[1663] "Communication means" refers to a means for sending and receiving data via a network such as the Internet.

[1664] "Location information" is geographical data that indicates the user's current location.

[1665] "Evacuation information" refers to information necessary for making an evacuation plan, such as the user's address, family composition, and special needs.

[1666] The "storage means" refers to a database or storage device for storing acquired information.

[1667] The "calculation means" is a means for performing calculation processing to generate an appropriate evacuation plan for each user based on the stored information.

[1668] The "notification means" is a means for automatically notifying the user of the generated evacuation plan when the occurrence of a disaster is detected.

[1669] An "alert" is a means of notifying the user of a warning by sound or vibration in the event of an emergency.

[1670] A "user interface" is a screen or operating means through which a user interacts with a system, inputs information, and checks notifications.

[1671] An "evacuation plan" is a plan for guiding evacuation actions in the event of a disaster, including the nearest evacuation facility and evacuation route for the user.

[1672] The "disaster information provision service" is a service for obtaining disaster information in real time from external organizations such as the Japan Meteorological Agency.

[1673] The disaster prevention plan evacuation route emergency automatic distribution system of this invention is a system that provides quick and accurate evacuation support by collecting information from users and automatically generating and distributing the optimal evacuation plan. This system consists of three main components: a server, a terminal, and a user.

[1674] System Configuration

[1675] server

[1676] The server is the core of this system and has the following main functions:

[1677] Information gathering methods

[1678] The server asks the user for necessary information (e.g., address, family composition) through the chatbot and obtains it. This is done using a natural language processing tool (e.g., Dialogflow).

[1679] storage means

[1680] The acquired information is stored in a database, which can be a general relational database management system (RDBMS).

[1681] means of calculation

[1682] The server generates an optimal evacuation plan for each user based on the collected information. Map services (e.g., Google Maps API) are used to identify evacuation shelters and calculate evacuation routes.

[1683] Notification means

[1684] The system detects the occurrence of a disaster and automatically notifies users of the generated evacuation plan via push notification and SMS, and in the event of an emergency, alerts users via sound and vibration.

[1685] Terminal

[1686] A terminal is a device through which a user interacts with the system, typically a smartphone or a PC.

[1687] communication means

[1688] The device communicates with a server via the Internet, allowing it to send and receive information and evacuation plans.

[1689] User Interface

[1690] A screen where a user can enter information or view notifications from a server. This includes web applications and smartphone apps.

[1691] User

[1692] A user is an individual or group that uses the system.

[1693] Registration and Information

[1694] Users register with the system using a device such as a smartphone and respond to the chatbot to provide the necessary information.

[1695] Actions to take in an emergency

[1696] When a disaster occurs, evacuation actions are taken based on the evacuation plan received from the server.

[1697] Specific examples

[1698] Collection of information

[1699] Server: "Please tell me your address."

[1700] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1701] The server stores this information in a storage means.

[1702] Generate evacuation plans

[1703] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[1704] Emergency Notification

[1705] When the server detects the occurrence of an earthquake, it sends a notification to the user saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below." The device receives this notification, displays it on the screen, and simultaneously issues an alert with sound and vibration.

[1706] Prompt Sentence Examples

[1707] Here are some examples of prompts for a generative AI model (e.g., GPT-4):

[1708] "Design a system for users to obtain the optimal evacuation route in the event of a disaster. The system consists of a server with chatbot functionality, a user device for inputting information, and the user themselves. Also, use a map service API for evacuation route calculation."

[1709] As described above, the present invention provides efficient and effective evacuation assistance.

[1710] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1711] Step 1: User registration and information provision

[1712] Users use devices such as smartphones or PCs to access the system's website or application and register their information. Specifically, users follow the instructions of the chatbot to enter information such as their address, family composition, and special needs. The device then sends this information to the server via communication means.

[1713] Input: Information provided by the user through the device (e.g., address)

[1714] Data processing: The terminal converts the input information into a structured format and sends it to the server.

[1715] Output: User information sent to the server

[1716] Step 2: Save your information

[1717] The server receives the information sent from the terminal, temporarily stores it in memory, then checks the validity of the information format and items, and if there are no problems, records it in a database.

[1718] Input: User information sent from the device

[1719] Data processing: The server verifies and converts the information

[1720] Output: User information stored in the database

[1721] Step 3: Identify shelters and generate plans

[1722] The server retrieves the user's address information from the database, identifies the nearest evacuation shelter using a map service (e.g., Google Maps API), calculates the evacuation route, and generates an appropriate evacuation plan.

[1723] Input: User address information stored in the database

[1724] Data processing: Identifying the nearest evacuation shelter and calculating evacuation routes based on the user's address

[1725] Output: Generated evacuation plan (e.g., map display of evacuation route)

[1726] Step 4: Save your evacuation plan

[1727] The server stores the generated evacuation plans in a database, which allows for quick access in the event of an emergency.

[1728] Input: Generated evacuation plan

[1729] Data processing: Format conversion and storage processing of evacuation plans

[1730] Output: Evacuation plan stored in database

[1731] Step 5: Detecting the occurrence of a disaster

[1732] The server monitors disaster information services (e.g., the Japan Meteorological Agency's API) in real time, and when it detects an abnormality, it obtains information about the occurrence of a disaster.

[1733] Input: Data stream from disaster information service

[1734] Data processing: Disaster information analysis and filtering

[1735] Output: Detected disaster information

[1736] Step 6: Generate emergency notifications

[1737] Based on the detected disaster information, the server retrieves the user's evacuation plan from the database and generates a notification message, which includes the nearest evacuation shelter, evacuation route, and links.

[1738] Input: Detected disaster information and evacuation plans stored in the database

[1739] Data processing: Notification message generation

[1740] Output: The generated notification message

[1741] Step 7: Send emergency notifications

[1742] The server generates a notification message and sends it to the user's device, which receives it, displays it on the user interface, and alerts the user with sound and vibration.

[1743] Input: The generated notification message

[1744] Data processing: Message sending process

[1745] Output: Notification message display and alert on user terminal

[1746] Specific operation example

[1747] Step 1: User Registration

[1748] User: "Can you tell me your address?"

[1749] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1750] The terminal sends this information to the server.

[1751] Step 3: Generate an evacuation plan

[1752] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the stored address information and calculates the evacuation route using the Google Maps API.

[1753] Step 7: Notification message

[1754] Server: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below."

[1755] The device receives this notification, displays it on the screen, and notifies the user with an alarm sound and vibration.

[1756] (Application example 1)

[1757] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1758] Rapid and appropriate evacuation assistance in emergencies is extremely important, especially for passengers in autonomous vehicles. Conventional evacuation assistance systems require passengers to collect information and select evacuation routes themselves in the event of a disaster, which can lead to delays in evacuation behavior and misjudgments. The present invention aims to solve these problems and provide rapid and appropriate evacuation assistance to passengers in autonomous vehicles.

[1759] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1760] In this invention, the server includes, as information collection means, means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, means for acquiring the location information and disaster information and calculating a route to the nearest evacuation shelter, and notification means for providing visual and audio evacuation instructions to passengers, thereby enabling passengers in autonomous vehicles to take swift and accurate evacuation actions in the event of a disaster.

[1761] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[1762] "Communication means" refers to a means for sending and receiving data over a network.

[1763] "Location information" is information that indicates the current physical location of a user or an autonomous vehicle.

[1764] "Evacuation information" refers to information that users and passengers will need when evacuating, including addresses and special needs.

[1765] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[1766] A "calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[1767] The "notification means" is a means for automatically notifying the user or passengers of the evacuation plan created in the event of a disaster.

[1768] The "means for detecting the occurrence of a disaster" is a means for acquiring disaster information from an external disaster information providing service.

[1769] The "nearest evacuation shelter" is the safest place to evacuate to from your current location.

[1770] The "evacuation route" is route information indicating the route that the user or passengers should take to reach the evacuation shelter.

[1771] "External disaster information services" are services that allow users to obtain the latest disaster information provided by the Japan Meteorological Agency and other public institutions.

[1772] "Visual and audio notification means" refers to means of providing evacuation instructions to passengers using displays and speakers.

[1773] A "server" is a central computing device in the system that collects, analyzes, stores, and notifies data.

[1774] The emergency evacuation support system for autonomous vehicles of the present invention is designed to provide prompt and appropriate evacuation support to passengers in the vehicle. This system consists of three main components: a server, a terminal, and a user.

[1775] System configuration

[1776] server

[1777] The server is the core of the system and has the following main functions:

[1778] 1. Information collection means: The server acquires location information and evacuation information from the user via communication means.

[1779] 2. Storage means: Stores the acquired location information and evacuation information in a database.

[1780] 3. Computational means: Generates an appropriate evacuation plan based on the stored information. This includes using map services to identify the nearest evacuation shelters and calculate evacuation routes.

[1781] 4. Notification method: When a disaster occurs, the evacuation plan will be automatically notified to the terminal.

[1782] 5. Disaster information acquisition method: Obtain the latest disaster information from external disaster information services.

[1783] 6. Evacuation route calculation method: Calculates the optimal route to the nearest evacuation shelter based on disaster information and location information.

[1784] Terminal

[1785] A terminal is a device that allows a user to interact with the system, such as a display or speaker installed inside an autonomous vehicle.

[1786] 1. Communication method: The terminal communicates with the server and receives evacuation instructions and route guidance.

[1787] 2. Notification methods: Provide visual and audio evacuation instructions to passengers.

[1788] User

[1789] A user is a passenger who uses the system and interacts with the system through the following steps:

[1790] 1. When you get into a vehicle, your location information is automatically sent to the system.

[1791] 2. When a disaster occurs, you will receive a notification from the system.

[1792] 3. Follow the notices and take action based on evacuation instructions.

[1793] Program processing

[1794] Hardware and Software

[1795] Hardware: GPS module, vehicle display, speaker.

[1796] Software: Python library, disaster information API, map service API (e.g. Google Maps API).

[1797] Data processing and calculation

[1798] 1. The server obtains location information from the GPS module.

[1799] 2. The server uses the disaster information provision API to obtain the latest disaster information.

[1800] 3. The server uses the map service API to calculate the optimal route from the current location to the nearest evacuation shelter.

[1801] 4. The device receives the notification from the server and provides evacuation instructions to passengers using the display and speaker.

[1802] Specific examples

[1803] Example 1: Obtaining location information

[1804] Server: Obtain the current location "Latitude: 35.6895, Longitude: 139.6917" from the GPS module.

[1805] Server: Stores this location information in a database.

[1806] Example 2: Obtaining disaster information

[1807] Server: Obtain information about an earthquake occurrence from the disaster information provision API.

[1808] Server: Analyzes this information and generates a corresponding evacuation plan.

[1809] Example 3: Calculating evacuation routes

[1810] Server: Uses the map service API to calculate the route from the current location to the nearest "shelter A."

[1811] Example 4: Providing evacuation instructions

[1812] Device: Receives a notification from the server and displays "Please head to shelter A. Route guidance is here."

[1813] Terminal: A voice message will be displayed through the speaker saying, "The nearest evacuation shelter is Evacuation shelter A. Please follow the instructions."

[1814] Generative AI model prompt sentence

[1815] Write a Python program that retrieves the latest disaster information, calculates the optimal route from the current location to the nearest evacuation shelter, and notifies passengers in an autonomous vehicle. It uses the Google Maps API and Weather Information API, and obtains location information from the GPS module.

[1816] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1817] Step 1:

[1818] Processing: Information gathering

[1819] Subject: Server

[1820] Operation: The server obtains the current location information from the GPS module.

[1821] Input: current vehicle location

[1822] Data processing: Obtain latitude and longitude information from the GPS and convert it into coordinate data.

[1823] Output: Location information (e.g. "Latitude: 35.6895, Longitude: 139.6917")

[1824] Specific operation: The server accesses the GPS module, obtains the current location data, and stores it in the database.

[1825] Step 2:

[1826] Processing: Acquisition of disaster information

[1827] Subject: Server

[1828] Operation: The server uses the disaster information provision API to obtain the latest disaster information.

[1829] Input: API endpoint and access key

[1830] Data processing: Analyze disaster information obtained from the API and process it into valid data.

[1831] Output: Disaster information (e.g., "Earthquake occurred")

[1832] Specific operation: The server sends a request to the API of the disaster information service, analyzes the received response, and obtains disaster information.

[1833] Step 3:

[1834] Processing: Evacuation route calculation

[1835] Subject: Server

[1836] Operation: The server uses the map service API to calculate the optimal route to the nearest evacuation shelter.

[1837] Input: Location information and disaster information

[1838] Data processing: Using location information and disaster information, request parameters are generated to calculate the optimal evacuation route.

[1839] Output: Evacuation route information (e.g., "Route to shelter A")

[1840] Specific operation: The server sends a request to the map service API, analyzes the received route guidance information, and calculates the optimal evacuation route.

[1841] Step 4:

[1842] Action: Evacuation plan notification

[1843] Subject: Terminal

[1844] Operation: The terminal notifies the passengers of the evacuation plan received from the server.

[1845] Input: Evacuation route information and evacuation shelter information

[1846] Data Processing: Converting evacuation route information into a format for visual and audio notifications.

[1847] Output: Visual and audio evacuation instructions

[1848] Specific operation: The device displays evacuation route information on the display and outputs evacuation instructions aloud from the speaker.

[1849] Step 5:

[1850] Action: User initiates action

[1851] Subject: User

[1852] Action: The user begins evacuation based on the notified evacuation plan.

[1853] Input: Evacuation instructions from terminal

[1854] Data processing: Follow the evacuation instructions and create a specific action plan.

[1855] Output: Actual evacuation behavior

[1856] Specific operation: The user follows the route guidance displayed on the display and voice instructions to head to the nearest evacuation shelter.

[1857] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1858] This invention is a system that provides evacuation support that takes into consideration the user's emotions by combining an automatic emergency distribution system for disaster prevention plans and evacuation routes with an emotion engine. This system consists of three main components: a server, a terminal, and a user.

[1859] System configuration

[1860] server

[1861] The server is the core of the system and has the following main functions:

[1862] 1. Information collection method: Obtain location information and evacuation information from the user.

[1863] 2. Storage means: Stores the acquired information in a database.

[1864] 3. Calculation method: Generate an evacuation plan for each user based on the stored information.

[1865] 4. Notification method: Evacuation plans are automatically sent to users in the event of a disaster.

[1866] 5. Emotion engine: Recognizes the user's emotional state and responds accordingly.

[1867] Terminal

[1868] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1869] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[1870] 2. User Interface: The screen where the user enters information and checks notifications.

[1871] 3. Emotion recognition means: Recognizes emotions from the user's voice and facial expressions using the device's microphone and camera.

[1872] User

[1873] A user is an individual or group who uses the system and interacts with it through the following steps:

[1874] 1. Register in the system using a device such as a smartphone.

[1875] 2. Answer the chatbot's questions and provide the necessary information (address, family composition, special needs, etc.).

[1876] 3. Use emotion recognition tools to communicate your mood and emotions to the system.

[1877] 4. When a disaster occurs, take evacuation action based on the evacuation plan received.

[1878] Program processing explanation

[1879] 1. Collection of information

[1880] The server asks the user for necessary information (e.g., address, family composition) through the chatbot. When the user answers, the information is stored in a database by the server.

[1881] 2. Recognizing emotional states

[1882] The device uses a microphone and camera to analyze the user's voice and facial expressions and transmits the data to an emotion engine, which then recognizes the user's emotional state through voice analysis, facial expression recognition, text analysis, or a combination thereof.

[1883] 3. Generate an evacuation plan

[1884] The server uses the collected information to identify the nearest evacuation shelter and calculate evacuation routes, including the ability to generate route guidance using a map service.

[1885] 4. Emotional Adjustment

[1886] The server adjusts the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds encouraging and reassuring messages to the evacuation plan.

[1887] 5. Emergency Notification

[1888] When a disaster occurs, the server obtains information from the disaster information service and automatically notifies the user of an appropriate evacuation plan based on the user's registered information and emotional state. The notification includes the address of the evacuation shelter, a link to the evacuation route, and a message according to the user's emotional state.

[1889] Specific examples

[1890] Example 1: Information gathering and emotion recognition

[1891] Server: "Please tell me your address."

[1892] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1893] The server stores this information in a storage means.

[1894] The terminal detects whether the user is nervous from their facial expression.

[1895] The emotion engine determines that the user is feeling anxious.

[1896] Example 2: Generating an evacuation plan

[1897] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map service.

[1898] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[1899] Example 3: Emergency notification

[1900] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[1901] "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[1902] This allows users to take quick and accurate evacuation action, making it easier to dispel anxiety.

[1903] As described above, the present invention provides more effective evacuation assistance by recognizing and considering the user's emotional state, thereby helping the user to evacuate safely and providing a sense of mental security.

[1904] The processing flow will be explained below.

[1905] Step 1:

[1906] The server sends a message to the user through the chatbot asking, "What is your address?"

[1907] Step 2:

[1908] The user enters their address (e.g., "1-2-3 Jinnan, Shibuya-ku, Tokyo") into the chatbot and submits it.

[1909] Step 3:

[1910] The server stores the received address information in the "User Information" table of the database.

[1911] Step 4:

[1912] The server then sends the user a question: "Please tell us your family structure."

[1913] Step 5:

[1914] The user inputs the family composition (e.g., "husband, two children") and submits it.

[1915] Step 6:

[1916] The server similarly stores the received family composition information in the "user information" table.

[1917] Step 7:

[1918] Finally, the server sends the question, "Do you have any special evacuation needs (e.g., wheelchair, pets, etc.)?"

[1919] Step 8:

[1920] The user enters their special needs (e.g., "One pet (dog)") and submits.

[1921] Step 9:

[1922] The server stores the received special needs information in a database.

[1923] Step 10:

[1924] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends them to a server for analysis.

[1925] Step 11:

[1926] The emotion engine located in the server analyzes the received data and recognizes the user's emotional state (e.g., tension, anxiety, calmness).

[1927] Step 12:

[1928] The server identifies the nearest evacuation shelter based on the user information and the recognized emotional state. It uses a map API to calculate the location of the nearest evacuation shelter from the user's address.

[1929] Step 13:

[1930] The server also uses the map API to calculate the evacuation route to the identified shelter.

[1931] Step 14:

[1932] The server stores the evacuation plans generated for each user in an "Evacuation Plan" table.

[1933] Step 15:

[1934] The server adjusts parts of the evacuation plan based on the user's emotional state as recognized by the emotion engine. For example, if a user is feeling anxious or scared, the server adds a message to the evacuation plan such as "Don't worry, you can evacuate with your family."

[1935] Step 16:

[1936] The server periodically acquires new disaster information from the disaster information service.

[1937] Step 17:

[1938] When the server receives new disaster information, it collects user data from affected areas and automatically sends evacuation plans to the affected users based on that data.

[1939] Step 18:

[1940] The device receives the notification from the server and displays a message to the user, including the address of the evacuation shelter, a link to the evacuation route, and a message that provides reassurance depending on the user's emotional state.

[1941] Step 19:

[1942] The user checks the received message and promptly begins evacuation according to the evacuation plan. During evacuation, the user can remain calm while referring to the reassuring message.

[1943] In this way, the system collects user information at each step, recognizes their emotional state, generates an individually optimized evacuation plan, and provides evacuation information quickly in the event of an emergency, thereby helping users evacuate safely and reducing anxiety and fear.

[1944] Example 2

[1945] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1946] Conventional evacuation support systems only provide evacuation routes based on the user's location information, but have the problem of not taking the user's emotional state into consideration. This can lead to difficulties in smoothly carrying out evacuation actions, especially in emergencies when the user feels anxious or scared. Therefore, there is a need for a system that can take the user's emotional state into consideration and provide appropriate evacuation support according to that state.

[1947] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1948] In this invention, the server includes: an information gathering means for acquiring location information and evacuation information from the user via a communication means; a storage means for saving the acquired location information and evacuation information; a calculation means for generating an appropriate evacuation plan for the user based on the saved information; a notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan; and an emotion engine for recognizing the emotional state of the user and taking action according to that emotional state. This makes it possible to support quick and appropriate evacuation behavior while taking the user's emotional state into consideration.

[1949] The "information collection means" is a means for acquiring location information and evacuation information from the user via a communication means.

[1950] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[1951] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[1952] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[1953] An "emotion engine" is a means for recognizing the user's emotional state and responding accordingly.

[1954] The "disaster information provision service" is a service for obtaining disaster information from external sources.

[1955] A "shelter" is a facility or place where users can take refuge in the event of a disaster.

[1956] An "evacuation route" is a route that a user takes to reach a shelter.

[1957] This invention is a system that considers the emotional state of the user and provides an appropriate evacuation plan in the event of a disaster. The system consists of three main components: a server, a terminal, and a user.

[1958] server

[1959] The server is the core of the system and has the following main functions:

[1960] 1. Information collection method: The server acquires location information and evacuation information from the user via communication methods. For example, it uses a chatbot function to ask the user questions about their address, family composition, etc., and stores the user's responses in a database.

[1961] 2. Storage means: The server stores the acquired location information and evacuation information in a database.

[1962] 3. Calculation method: The server generates an appropriate evacuation plan for each user based on the stored information. For example, it uses a map service (e.g., map API) to identify the nearest evacuation shelter and calculate the evacuation route.

[1963] 4. Notification method: When the server detects the occurrence of a disaster, it automatically notifies the user of the generated evacuation plan.

[1964] 5. Emotion engine: The server recognizes the user's emotional state and responds accordingly. For example, if the user is feeling anxious using the emotion engine, the server adds the phrase "Don't worry, you can evacuate with your family" to the notification message.

[1965] Terminal

[1966] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[1967] 1. Communication means: The terminal sends information to the server via the Internet and receives notifications from the server.

[1968] 2. User Interface: The device has a screen where the user can enter information and view notifications.

[1969] 3. Emotion recognition means: The device uses a microphone and camera to recognize emotions from the user's voice and facial expressions, and sends that data to the emotion engine.

[1970] User

[1971] A user is an individual or group who uses the system and interacts with it through the following steps:

[1972] 1. The user registers in the system using a device such as a smartphone.

[1973] 2. The user answers the chatbot's questions and provides the necessary information (address, family composition, special needs, etc.).

[1974] 3. The user communicates their mood and emotions to the system using emotion recognition means, such as collecting emotion data using the device's camera or microphone.

[1975] 4. When a disaster occurs, the user takes evacuation action based on the received evacuation plan.

[1976] Specific examples

[1977] Example 1: Information gathering and emotion recognition

[1978] Server: "Please tell me your address."

[1979] User: "1-2-3 Jinnan, Shibuya-ku, Tokyo"

[1980] The server stores this information in a storage means.

[1981] The device captures the user's facial expressions with a camera and analyzes their voice with a microphone, and sends this data to an emotion engine to measure the user's emotional state.

[1982] The emotion engine determines that the user is feeling anxious.

[1983] Example 2: Generating an evacuation plan

[1984] The server identifies the nearest evacuation shelter (e.g., Yoyogi Park) from the address information and calculates the evacuation route using a map API.

[1985] The notification message will include the phrase "Don't worry, you can evacuate with your family."

[1986] Example 3: Emergency notification

[1987] When the server detects an earthquake, it obtains the latest information from the disaster information service.

[1988] Notification message: "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Please rest assured, you can evacuate with your family."

[1989] Users can receive this notification and take immediate action to evacuate by following the designated evacuation route.

[1990] As described above, the present invention can take into consideration the emotional state of the user and support prompt and appropriate evacuation behavior.

[1991] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1992] Step 1: Gather information

[1993] The server uses a chatbot to ask the user for location information and evacuation information. For example, it asks, "What is your address?" and the user answers, "1-2-3 Jinnan, Shibuya-ku, Tokyo." This information is then stored in a database.

[1994] Input: User's answer (address information, etc.)

[1995] Output: User information stored in the database

[1996] Step 2: Recognizing your emotional state

[1997] The device uses a microphone and camera to capture the user's voice and facial expressions, and sends that data to the emotion engine. The emotion engine then uses voice analysis and facial recognition technology to recognize the user's emotional state. For example, it can determine that the user is feeling anxious based on their facial expression or voice.

[1998] Input: User data (voice, facial expressions) obtained from microphone and camera

[1999] Output: User's emotional state data

[2000] Step 3: Generate an evacuation plan

[2001] The server uses the saved user information to identify the nearest evacuation shelter using a map service API and calculates an evacuation route. For example, it identifies Yoyogi Park as the nearest evacuation shelter based on the address information and creates an evacuation route to that location.

[2002] Input: User information in the database (address)

[2003] Output: Nearest evacuation shelter and evacuation route information

[2004] Step 4: Emotional Adjustment

[2005] The server uses the user's emotional state recognized by the emotion engine to tailor the evacuation plan notification message, for example adding a message like "Don't worry, you can evacuate with your family" to a user who is feeling anxious.

[2006] Input: User emotional state data

[2007] Output: Coordinated evacuation plan notification message

[2008] Step 5: Emergency Notification

[2009] When a disaster occurs, the server obtains the latest disaster information from an external disaster information service. For example, if an earthquake occurs, the server automatically notifies the user of an evacuation plan based on the user's registered information and emotional state.

[2010] Input: Latest information from disaster information services

[2011] Output: A personalized evacuation plan notification sent to the user.

[2012] Each of these steps allows the user to evacuate quickly and safely.

[2013] (Application example 2)

[2014] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2015] Conventional evacuation assistance systems do not take into account the user's emotional state and are unable to reduce the psychological burden of evacuation behavior. Furthermore, due to confusion that arises during emergencies, evacuation routes and guidance to evacuation shelters are often not properly implemented. Furthermore, the technology for utilizing autonomous vehicles for evacuation assistance is still underdeveloped, creating a need for an integrated evacuation assistance system.

[2016] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2017] In this invention, the server includes information collection means for acquiring location information and evacuation information from a user via communication means, storage means for saving the acquired location information and evacuation information, calculation means for generating an appropriate evacuation plan for the user based on the saved information, notification means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan, emotion engine means for recognizing the emotional state of the user and taking measures according to that emotional state, and means for connecting to a control device of the autonomous vehicle and controlling the autonomous vehicle based on the evacuation plan. This enables evacuation assistance that takes into account the emotional state of the user and further enables smooth evacuation guidance using an autonomous vehicle.

[2018] The "information collection means" is a means for acquiring location information and information regarding evacuation from the user via a communication means.

[2019] The "storage means" is a means for storing the acquired location information and information regarding evacuation.

[2020] "Calculation means" is a means for generating an appropriate evacuation plan for a user based on the stored information.

[2021] The "notification means" is a means for detecting the occurrence of a disaster and automatically notifying the user of the generated evacuation plan.

[2022] The "emotion engine means" is a means for recognizing the user's emotional state and taking measures according to that emotional state.

[2023] An "automated driving vehicle control device" is a device for controlling an automatically driving vehicle.

[2024] An "evacuation plan" is a plan that identifies appropriate evacuation shelters and evacuation routes based on the user's location information and the situation at the time of a disaster.

[2025] An "autonomous vehicle" is a vehicle that uses autonomous driving technology and can travel without the need for driver operation.

[2026] The "disaster information provision service" is a service that acquires disaster occurrence information from external sources.

[2027] "User's emotional state" refers to changes in the user's psychological state and emotions.

[2028] MODE FOR CARRYING OUT THE INVENTION

[2029] This invention is an automatic emergency distribution system for disaster prevention plans and evacuation routes that takes into account the user's emotional state, and also a system that provides evacuation support by integrating autonomous vehicles. This system consists of three main components: a server, a terminal, and an autonomous vehicle.

[2030] System configuration

[2031] server

[2032] The server is the core of the system and has the following main functions:

[2033] 1. Information collection method: Obtain location and evacuation information from the user, including the user's address, number of passengers, and special needs.

[2034] 2. Storage means: The acquired information is stored in a database. The acquired information includes the user's location, evacuation route, and evacuation shelter information.

[2035] 3. Calculation method: Generate an evacuation plan for each user based on the stored information. The calculation method includes a function to calculate routes taking into account traffic information and evacuation shelter information.

[2036] 4. Notification method: When a disaster occurs, evacuation plans are automatically sent to users. The notification method sends information to users' smartphones and autonomous vehicles.

[2037] 5. Emotion engine means: Recognizes the user's emotional state and takes appropriate measures based on that emotional state. The emotion engine means analyzes the user's emotions from their facial expressions and voice and generates appropriate messages.

[2038] Terminal

[2039] A terminal is a device (e.g., a smartphone) through which a user interacts with the system.

[2040] 1. Communication means: Send information to a server via the Internet and receive notifications from the server.

[2041] 2. User Interface: The screen where the user enters information and checks notifications.

[2042] 3. Emotion recognition: Emotions are recognized from the user's voice and facial expressions using the device's microphone and camera. Emotion recognition is performed using OpenCV and the Google Cloud Speech-to-Text API.

[2043] Autonomous vehicles

[2044] Autonomous vehicles are used to safely guide users during evacuations.

[2045] 1. Location information acquisition means: Uses a GPS module to acquire the current location.

[2046] 2. Vehicle control means: Autonomous driving is controlled based on the user's evacuation plan. Autonomous driving software (e.g., Autoware) is used for vehicle control.

[2047] 3. User interface: Using displays and voice guidance systems inside the autonomous vehicle, users will be notified of evacuation routes and messages based on their emotions.

[2048] Program processing explanation

[2049] The server first collects and stores user information. It then uses the device's camera and microphone to recognize the user's emotional state and analyzes it using an emotion engine. The server then generates an optimal evacuation plan based on the collected information and the user's emotional state. This evacuation plan is then sent to the autonomous vehicle's control system. The autonomous vehicle then guides the user safely according to the evacuation plan, notifying them of the evacuation route and emotionally sensitive messages via in-car displays and voice messages.

[2050] Specific examples

[2051] Example 1: Information gathering and emotion recognition

[2052] Server: "Please tell me your address."

[2053] User: "Address: 1-2-3 Jinnan, Shibuya-ku, Tokyo"

[2054] The server stores this information.

[2055] The terminal detects whether the user is nervous from their facial expression.

[2056] The emotion engine determines that the user is feeling anxious.

[2057] Example 2: Generating an evacuation plan

[2058] The server identifies the nearest evacuation shelter from the address information and calculates the evacuation route.

[2059] Based on the emotional information obtained by the emotion engine, the notification message will include the phrase "Don't worry, you can evacuate with your family."

[2060] Example 3: Emergency notification

[2061] When the server detects the occurrence of an earthquake, it notifies the user as follows:

[2062] "An earthquake has occurred. We are heading to the nearest evacuation shelter. Please rest assured, you can evacuate with your family."

[2063] The autonomous vehicle will follow the evacuation plan and safely guide the user to the nearest evacuation shelter.

[2064] Also, as an example of a specific prompt sentence, enter the following:

[2065] "The user's face should detect signs of tension, and their voice should detect signs of anxiety."

[2066] This allows the present invention to provide efficient and safe evacuation assistance while taking into consideration the user's emotional state and providing a sense of psychological security. By combining this with autonomous driving technology, even greater convenience and safety are ensured.

[2067] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2068] Step 1:

[2069] Information gathering

[2070] The server receives location and evacuation information from the user via communication means. This information includes the user's address, number of passengers, and special needs. For example, when a user enters "1-2-3 Jinnan, Shibuya-ku, Tokyo" through a smartphone app, the information is sent to the server. The server stores this information in a database.

[2071] Step 2:

[2072] emotion recognition

[2073] The device uses a built-in microphone and camera to capture the user's voice and facial expressions. This data is sent to the emotion engine, which uses a generative AI model to analyze the voice and recognize facial expressions. For example, if the user's facial expression shows tension or anxiety, the emotion engine will determine this as "anxiety." This result is then sent to the server.

[2074] Step 3:

[2075] Generate evacuation plans

[2076] The server generates an appropriate evacuation plan for each user based on the saved location and emotion information. Map data and traffic information are used to generate the plan, and the nearest evacuation shelter and its route are calculated. For example, Yoyogi Park is identified as the nearest evacuation shelter, and a specific evacuation route is calculated using the Google Maps API. A notification message is generated based on the calculation results and emotion information. If the emotion information is "anxiety," the notification message will include the message, "Don't worry, you can evacuate with your family."

[2077] Step 4:

[2078] notification

[2079] The server notifies the device of the generated evacuation plan and a message. The device then displays the evacuation plan to the user through a user interface. For example, when an earthquake occurs, a message is displayed saying, "An earthquake has occurred. The nearest evacuation shelter is Yoyogi Park. Please check the evacuation route from the link below. Don't worry, you can evacuate with your family."

[2080] Step 5:

[2081] Autonomous vehicle control

[2082] The server sends the generated evacuation plan to the autonomous vehicle's control device, and the vehicle control system operates according to the plan. Specifically, the vehicle automatically begins moving along the calculated route. For example, if the nearest evacuation shelter is Yoyogi Park, the vehicle control system will use GPS data to guide the vehicle in that direction, taking into account traffic conditions along the way in real time.

[2083] Step 6:

[2084] Ongoing monitoring and adjustment

[2085] The server and device continuously monitor the user's emotional state and location, adjusting the evacuation plan as needed. For example, if the user shows strong anxiety again during the evacuation, the emotion engine will reassess in real time, and the server will generate additional messages to reassure the user.

[2086] The above is the specific processing flow of the system that realizes this application example. It shows how the hardware and software used in each step work together and what kind of data processing or data calculation is performed. This realizes efficient and safe evacuation support while taking into account the user's emotional state.

[2087] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2088] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2089] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2090] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2091] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2092] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2093] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2094] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2095] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2096] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2097] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2098] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2099] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2100] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2101] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2102] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2103] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2104] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2105] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2106] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2107] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2108] The following is further disclosed regarding the above embodiment.

[2109] (Claim 1)

[2110] as information collection means, means for acquiring location information and evacuation information from a user via communication means;

[2111] a storage means for storing the acquired location information and information regarding evacuation;

[2112] a computing means for generating an appropriate evacuation plan for the user based on the stored information;

[2113] a notification means for detecting the occurrence of a disaster and automatically notifying a user of the generated evacuation plan;

[2114] A system including:

[2115] (Claim 2)

[2116] 2. The system according to claim 1, wherein the means for detecting the occurrence of a disaster is a means for obtaining information from an external disaster information providing service.

[2117] (Claim 3)

[2118] The system of claim 1 , wherein the evacuation plan includes the nearest evacuation shelter and an evacuation route based on the location information.

[2119] "Example 1"

[2120] (Claim 1)

[2121] as information collection means, means for acquiring location information and evacuation information from a user via communication means;

[2122] a storage means for storing the acquired location information and information regarding evacuation;

[2123] a computing means for generating an appropriate evacuation plan for the user based on the stored information;

[2124] a notification means for detecting the occurrence of a disaster and automatically notifying a user of the generated evacuation plan;

[2125] The notification means is a means for sending an alert accompanied by sound or vibration in the event of an emergency;

[2126] means for providing a user interface to be displayed on a user's terminal;

[2127] A system including:

[2128] (Claim 2)

[2129] 2. The system according to claim 1, wherein the means for detecting the occurrence of a disaster is a means for obtaining information from an external disaster information providing service.

[2130] (Claim 3)

[2131] The system according to claim 1 , wherein the evacuation plan includes the nearest evacuation facility and an evacuation route based on the location information.

[2132] "Application Example 1"

[2133] (Claim 1)

[2134] as information collection means, means for acquiring location information and evacuation information from a user via communication means;

[2135] a storage means for storing the acquired location information and information regarding evacuation;

[2136] a computing means for generating an appropriate evacuation plan for the user based on the stored information;

[2137] a notification means for detecting the occurrence of a disaster and automatically notifying a user of the generated evacuation plan;

[2138] A means for obtaining location information and disaster information and calculating a route to the nearest evacuation shelter;

[2139] Notification means to provide passengers with visual and audio evacuation instructions;

[2140] A system including:

[2141] (Claim 2)

[2142] 2. The system according to claim 1, wherein the means for detecting the occurrence of a disaster is a means for obtaining information from an external disaster information providing service.

[2143] (Claim 3)

[2144] The system of claim 1 , wherein the evacuation plan includes the nearest evacuation shelter and an evacuation route based on the location information.

[2145] "Example 2: Combining Emotion Engines"

[2146] (Claim 1)

[2147] as information collection means, means for acquiring location information and evacuation information from a user via communication means;

[2148] a storage means for storing the acquired location information and evacuation information;

[2149] a computing means for generating an appropriate evacuation plan for the user based on the stored information;

[2150] a notification means for detecting the occurrence of a disaster and automatically notifying a user of the generated evacuation plan;

[2151] an emotion engine that recognizes the user's emotional state and responds accordingly;

[2152] A system including:

[2153] (Claim 2)

[2154] 2. The system according to claim 1, wherein the means for detecting the occurrence of a disaster is a means for obtaining information from an external disaster information providing service.

[2155] (Claim 3)

[2156] The system of claim 1 , wherein the evacuation plan includes the nearest evacuation shelter and its evacuation route based on the location information.

[2157] "Application example 2 when combining emotion engines"

[2158] (Claim 1)

[2159] as information collection means, means for acquiring location information and evacuation information from a user via communication means;

[2160] a storage means for storing the acquired location information and information regarding evacuation;

[2161] a computing means for generating an appropriate evacuation plan for the user based on the stored information;

[2162] a notification means for detecting the occurrence of a disaster and automatically notifying a user of the generated evacuation plan;

[2163] an emotion engine means for recognizing an emotional state of a user and taking measures in accordance with the emotional state;

[2164] a means for connecting to a control device of the autonomous vehicle and controlling the autonomous vehicle based on the evacuation plan;

[2165] A system including:

[2166] (Claim 2)

[2167] 2. The system according to claim 1, wherein the means for detecting the occurrence of a disaster is a means for obtaining information from an external disaster information providing service.

[2168] (Claim 3)

[2169] 2. The system according to claim 1, wherein the evacuation plan includes the nearest evacuation shelter and an evacuation route based on the location information, and notifies the user of a message according to the user's emotional state. [Explanation of symbols]

[2170] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. as information collection means, means for acquiring location information and evacuation information from a user via communication means; a storage means for storing the acquired location information and information regarding evacuation; a computing means for generating an appropriate evacuation plan for the user based on the stored information; a notification means for detecting the occurrence of a disaster and automatically notifying a user of the generated evacuation plan; A system including:

2. 2. The system according to claim 1, wherein the means for detecting the occurrence of a disaster is a means for acquiring information from an external disaster information providing service.

3. The system of claim 1 , wherein the evacuation plan includes the nearest evacuation shelter and an evacuation route based on the location information.

Images