system

Abstract

We provide the system. [Solution] A means of detecting the user's body temperature, generating electricity using the temperature difference, and storing that electricity, A navigation means that acquires location information and determines the travel route, An emergency communication means that transmits the user's current location and health information to an external party in an emergency, A management system that automatically updates the status upon entering and descending the mountain, and records and notifies information externally, A safety support system including this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Mountaineers including the elderly and visitors are at risk of getting lost or their health deteriorating in mountainous areas, making it difficult to climb safely. Conventional devices may not function sufficiently in an emergency due to the risk of battery depletion. Also, the management of in-and-out mountain information is complicated, and information transmission to family or rescue teams may not be rapid.

Means for Solving the Problems

[0005] This invention reduces the risk of battery depletion by providing a device equipped with a charging means that continuously supplies power using the user's body temperature. Furthermore, it provides safe route guidance using GPS-based navigation and includes an emergency communication means that quickly transmits the user's location and health status to external parties in emergencies, thereby streamlining information transmission to family and rescue teams. In addition, it enables continuous monitoring of the user's safety by implementing a management means that automatically updates the status upon entering and descending a mountain.

[0006] A "means for detecting body temperature" refers to a device that senses the user's skin temperature and generates electricity based on that temperature.

[0007] "Methods of generating electricity using temperature differences" refer to mechanisms that generate electricity by utilizing the difference between the external ambient temperature and body temperature, and supply it to a device.

[0008] "Navigation methods" refer to functions that use GPS or similar technologies to obtain the current location and provide directions to the destination.

[0009] "Emergency communication means" refers to a communication system that enables the rapid transmission of a user's location and health information to external parties in the event of an emergency.

[0010] The "management system for updating entry and exit status" is a mechanism that automatically detects the trailhead and exit point, and records and notifies users of their entry and exit from the mountain. [Brief explanation of the drawing]

[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4]This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0013] First, let's explain the terminology used in the following explanation.

[0014] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0015] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0016] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0017] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0019] [First Embodiment]

[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0032] This invention provides a device that functions as a system to support mountain climbers in safely climbing mountains. This device is equipped with a means of sustained power generation using body heat, GPS-based navigation, and emergency communication means. It also has a function to automatically manage the status when entering and descending a mountain and notify the user and related parties of the information.

[0033] Program Processing Description

[0034] The device constantly detects the user's body temperature using sensors, generates power using the temperature difference, and stores it in the battery. This plays a crucial role in preventing the device from running out of battery.

[0035] The device uses GPS to determine the user's location and navigates the hiking route based on surrounding terrain data. While walking, the user receives real-time location information and directional guidance through the device's screen, enabling safe route selection.

[0036] In an emergency, pressing the SOS button on the device immediately sends information about the user's current location and health status to the server. Upon receiving this information, the server automatically notifies registered emergency contacts and arranges for the user to receive the necessary assistance.

[0037] Furthermore, the device automatically recognizes beacons installed at the trailhead and exit point, recording the user's entry and exit from the mountain. The server manages this data and notifies family members and relevant parties of the progress. This allows for real-time monitoring of the user's climbing status.

[0038] As a concrete example, when a user begins climbing a mountain, the device provides an appropriate climbing route and tracks progress in real time. In the event of any health problems, the abnormality detection function activates and immediate action is taken. Upon completion of the climb, the device recognizes the descent beacon, completes the recording, and automatically notifies the user's family of the entire climbing process. In this way, the present invention makes mountain climbing a safer and more secure activity.

[0039] The following describes the processing flow.

[0040] Step 1:

[0041] The device periodically measures the user's skin temperature using a body temperature sensor and detects changes in that temperature. At the same time, it also measures the ambient temperature and calculates the temperature difference.

[0042] Step 2:

[0043] The device performs thermal-electric conversion based on the measured temperature difference, generating power and storing it in the battery. This process enables the device to have a continuous power supply.

[0044] Step 3:

[0045] The device uses a GPS module to periodically obtain its current geographical location and uses that information to display the climber's current location on a map.

[0046] Step 4:

[0047] Users can check their current location and recommended route information through the device's interface and follow a safe hiking route by moving in the indicated direction.

[0048] Step 5:

[0049] The device monitors health and activity levels, such as abnormal heart rate and movement speed, and immediately reports any abnormalities to the server.

[0050] Step 6:

[0051] If a user experiences an emergency, pressing the SOS button on their device will automatically send their location and health data to the server.

[0052] Step 7:

[0053] Based on the emergency information received from the terminal, the server quickly sends notifications to pre-configured emergency contacts and initiates necessary rescue arrangements.

[0054] Step 8:

[0055] During ascent and descent, the device detects beacon signals and automatically updates and records the user's entry or descent status based on those signals.

[0056] Step 9:

[0057] The server stores data on entering and descending the mountain in the cloud and notifies the user's family and registered contacts about the progress, allowing them to keep track of the user's status.

[0058] (Example 1)

[0059] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0060] Mountain climbing in mountainous areas involves harsh natural conditions and carries a high risk of getting lost or injured. Therefore, maintaining power levels, accurately tracking location information, and responding quickly in emergencies are essential for safe climbing. Furthermore, accurately recording the start and end of climbs and coordinating smoothly with external parties are also required, but only a limited number of systems can efficiently handle these tasks.

[0061] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0062] In this invention, the server includes means for detecting the user's body temperature, generating power using the temperature difference, and storing it in a power supply device; navigation means for acquiring location information and guiding the user's route based on topographic information; and emergency communication means for transmitting the user's current location and health information to a central device in an emergency. This enables the maintenance of an appropriate amount of power at all times, optimal route guidance based on location information, and rapid emergency response. Furthermore, by providing management means that automatically record the status at the start and end of a climb and notify the information to a recording medium and relevant parties, the progress of the climb can be accurately grasped, enabling safe climbing.

[0063] "User" refers to an individual who uses this system to climb mountains.

[0064] "Body temperature" refers to the temperature maintained by the human body, and it provides an energy source for generating electricity.

[0065] "Generating electricity" means creating electrical energy by utilizing the temperature difference obtained from a sensor.

[0066] A "power supply unit" is a device for storing and supplying generated electricity.

[0067] "Location information" refers to geographical location data identified using positioning technologies such as GPS.

[0068] "Topographical information" refers to data about the topography and geographical characteristics of a region, and forms the basis for route guidance.

[0069] "Navigation methods" refer to techniques used to guide climbers based on location and topographical information.

[0070] "Emergency communication means" refers to communication methods used to transmit current location and health information to external devices in times of emergency.

[0071] The term "central system" refers to an external management system that receives information via emergency communication means.

[0072] "Recording the status" refers to the act of automatically writing down information about the start and end of a mountain climb.

[0073] A "recording medium" refers to a device or means used to store information.

[0074] "Related parties" refers to individuals or organizations, such as family members or rescue teams, who are involved in ensuring the safety of the user.

[0075] This invention is a system designed to enable mountain climbers to perform their activities safely and efficiently. The system primarily consists of a power generation device that utilizes the user's body heat, a navigation system based on location information, an emergency communication system, and a beacon detection device for automatically recording and managing the system's status.

[0076] The device uses sensors to detect the user's body temperature in real time, generates power from the temperature difference using a Peltier element, and stores that power in the battery. As a result, the device has less to worry about running out of battery and can be used for extended periods.

[0077] The device uses a GPS module to acquire location information and calculates the optimal route based on the acquired coordinate data and terrain data. This navigation function visually displays real-time location information and direction of travel to the user on the screen. This allows the user to choose a safe route.

[0078] In an emergency, the terminal's emergency communication system transmits the user's current location and health status to a central device. Based on this information, the server notifies registered emergency contacts and appropriate rescue organizations to ensure the user receives prompt assistance.

[0079] Furthermore, the device is equipped with a beacon detection function to automatically record the user's status at the start and end of a climb. Beacons are installed at the trailhead and the end of the climb, and the device recognizes the beacon signal and transmits the information to a server. The server uses this data to provide progress information to family members and other relevant parties, allowing for real-time management of the user's climbing status.

[0080] For example, the device is designed to operate stably even in harsh environments and can withstand rapid temperature changes in mountainous areas. Furthermore, it is designed to respond quickly if a user becomes unwell.

[0081] An example of a prompt message would be: "Using a generative AI model, please describe in detail the features of a climber support system based on GPS and body heat generation. Include specific functions and examples to ensure the user can climb safely."

[0082] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0083] Step 1:

[0084] The device continuously measures the user's body temperature using sensors. It receives data on the user's body temperature and ambient temperature as input, generates power through temperature difference calculations using a Peltier element, and stores the resulting power in a battery. This allows the device to provide continuous power for extended periods.

[0085] Step 2:

[0086] The device uses a GPS module to obtain the user's current location. It takes satellite location data as input and analyzes topographic information based on the coordinate data. As a result, it displays an appropriate hiking route and direction on the device's screen. The user is then supported in choosing a safe route based on this information.

[0087] Step 3:

[0088] If a user experiences an emergency, the device uses emergency communication to transmit the user's current location and health information to a server. This data is collected as input and transmitted wirelessly to the server. Based on the received data, the server quickly notifies registered emergency contacts and rescue organizations to arrange for user assistance.

[0089] Step 4:

[0090] The device detects beacons installed at the trailhead and exit point to recognize the start and end of the climb. It receives beacon signals as input, analyzes them to determine the climber's entry and exit status, and sends status data to a server as output, providing progress information to the user's family and related parties. This enables real-time status management, ensuring peace of mind for users.

[0091] (Application Example 1)

[0092] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0093] During mountaineering activities, there is a need to ensure the safety of users while providing a method for external observers to monitor progress in real time. While conventional technologies offer individual functions such as emergency information transmission and continuous power generation using body heat, they lack a comprehensive system that effectively utilizes these functions to facilitate timely information sharing between users and external observers. Therefore, there is a strong desire to further improve the safety of mountaineers and their ability to respond to unforeseen circumstances.

[0094] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0095] In this invention, the server includes means for detecting the user's body temperature, generating electricity using the temperature difference, and storing power; navigation means for acquiring location information and identifying the travel route; communication means for transmitting the user's current location and health information to an external party in an emergency; management means for automatically updating the status when entering and descending a mountain, and recording and notifying the information to an external party; and information distribution means for sharing progress information with external observers in real time. This ensures the safety of users during mountain climbing, and allows external observers to immediately grasp the situation and take necessary actions quickly.

[0096] "A means of detecting body temperature, generating electricity using the temperature difference, and storing electricity" refers to a technology that generates and stores electricity using a power generation system that uses the difference between the user's body temperature and the ambient temperature as a power source.

[0097] A "navigation means for acquiring location information and determining a travel route" is a system that has the function of acquiring the user's current geographical location using a satellite positioning system or the like and determining a travel route.

[0098] "A communication means for transmitting the user's current location and health information to an external party in an emergency" refers to a device that transmits the user's location data and health information to external rescue organizations and related parties via wireless communication or other means in the event of an emergency.

[0099] A "management system that automatically updates status upon entering and descending a mountain and records and notifies information externally" refers to a system equipped with the function of automatically checking and recording the status of entering and descending a mountain when a climb is started and completed, and notifying an external server or relevant parties of that information.

[0100] "Information distribution method for sharing progress information with external observers in real time" refers to a system that transmits the user's current climbing status to relevant parties in real time using communication methods such as the internet.

[0101] The system implementing this invention mainly consists of three elements: a terminal, a server, and a user. The terminal is carried by the user and contains a device that continuously generates electricity using body heat. The terminal also has a GPS module, a temperature sensor, a communication module, and a beacon sensor, which collect and process various data. The generated power is stored, and this power operates the various functions of the terminal.

[0102] The device's detailed processing includes a temperature sensor that constantly monitors body temperature, using the temperature changes to generate power in a power generator and store it in a battery. A GPS module detects the user's current location and transmits this data to navigation software in real time. The navigation software compares this data with terrain data to provide a safe hiking route. In emergencies, a communication module transmits the user's location and health status to a server and notifies registered contacts.

[0103] The server uses the received information to determine whether the user's safety is ensured. It also manages the entry and exit status transmitted from the device and manages a system for notifying family members and relevant parties. Real-time progress information is also aggregated on the server and shared with external observers.

[0104] As a concrete example, when a user begins a climb, the device automatically recognizes the start of the climb, provides a safe route, and sends the user's progress to the server. The user's family can check the progress in real time from home and immediately contact rescue organizations in case of an emergency. This system supports safe mountain climbing activities.

[0105] An example of a prompt message might be: "Please explain in detail how this system manages and notifies emergency information to ensure the safety of climbers."

[0106] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0107] Step 1:

[0108] The device continuously detects the user's body temperature using a temperature sensor. The input is the user's skin temperature, and the sensor records the temperature changes. The temperature difference is converted into electricity by a thermoelectric generator and stored in a battery. This process generates the necessary power and supplies it to the various functions of the device.

[0109] Step 2:

[0110] The device uses a GPS module to obtain the user's location information. The input is a signal received from GPS satellites, which is used to generate the user's latitude and longitude data. Navigation software, integrated with a topographic map, processes this data and displays the optimal hiking route and current progress. The output is navigation instructions.

[0111] Step 3:

[0112] The device's communication module activates when the user presses the SOS button in an emergency. The input is an SOS signal from the user. The user's current location and health status data are sent to a pre-registered server. The server analyzes the received data and automatically notifies emergency contacts. The output is an emergency contact.

[0113] Step 4:

[0114] The device automatically detects beacons at the trailhead or exit point and updates the entry and exit status. The input is a signal from the beacon, which is used to modify the user's status data. The server processes this data and notifies registered family members or others of the progress. The output is an entry or exit status notification.

[0115] Step 5:

[0116] The server aggregates real-time progress information sent from terminals. Inputs include real-time location and route data. This data is processed and distributed so that external observers can view the information via a web portal or mobile app. Output is the distribution of progress information.

[0117] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0118] This invention provides a system that comprehensively supports the safety of mountain climbers, including a body temperature-utilizing charging mechanism, advanced navigation, emergency communication means, and management means, as well as a device equipped with an emotion engine. The emotion engine can analyze the user's emotional state in real time and provide warnings or assistance as needed.

[0119] Program Processing Description

[0120] In this system, the device constantly monitors the user's body temperature, generates power based on the temperature difference, and continuously charges the internal battery. This eliminates concerns about running out of power even during prolonged use.

[0121] The device further uses GPS functionality to obtain the user's precise location, displays their current location based on map data, and guides them along a recommended route. Users can then review this information and continue their climb following a safe route.

[0122] In an emergency, pressing the SOS button on the device instantly sends location and health data to a server, which then quickly notifies emergency contacts. This allows for a rapid response to the emergency.

[0123] The emotion engine analyzes the user's emotions in real time using voice recognition devices and biosensors installed in the device. For example, it determines the stress level from the user's tone of voice and facial expressions, and if necessary, provides relaxing messages via display or voice. If a sudden change in a particular emotion is detected, it notifies an external party of the situation through emergency communication channels.

[0124] As a concrete example, when a user feels anxious during a challenging climb, the emotion engine detects this change in emotion and displays a relaxing message. Simultaneously, if the abnormality persists, a notification is sent to the server, allowing family members in remote locations to be aware of it. In this form, the present invention comprehensively supports the physical and psychological state of climbers.

[0125] The following describes the processing flow.

[0126] Step 1:

[0127] The device continuously measures the user's body temperature using sensors and generates power using the temperature difference. This generated power is stored in the battery, enabling the device to operate continuously.

[0128] Step 2:

[0129] The device uses a GPS module to collect accurate current location information and combines it with map data to provide real-time directions to the user. This allows the user to safely navigate the hiking route.

[0130] Step 3:

[0131] The device uses a built-in emotion engine to analyze the user's voice data and information from biosensors to assess the user's emotional state, such as stress or anxiety.

[0132] Step 4:

[0133] If the emotion engine determines that the user's stress level is high, the device will provide the user with relaxing messages or appropriate action suggestions via voice or screen.

[0134] Step 5:

[0135] If the device determines that the user is in an emergency situation, pressing the SOS button will cause the device to immediately send the latest location information and health-related data to the server.

[0136] Step 6:

[0137] The server receives emergency information sent from the terminal and automatically sends notifications to registered emergency contacts. This information includes the user's current location and emotional state history.

[0138] Step 7:

[0139] The terminal picks up beacon signals installed at the trailhead and exit point and automatically records the user's entry or exit status. This information is recorded and notified to relevant parties via the server.

[0140] Through these steps, the system provides comprehensive support for user safety and offers peace of mind by managing information in real time, including psychological state.

[0141] (Example 2)

[0142] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0143] Ensuring the physical and psychological safety of users is a crucial issue in mountaineering and outdoor activities. Conventional technologies struggle to maintain a continuous power supply, especially during prolonged activities, and to adequately respond to changes in users' emotional states. Furthermore, there is a need for methods to quickly and accurately communicate the situation to the outside in emergency situations.

[0144] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0145] In this invention, the server includes means for detecting the user's body temperature and generating and storing power using the temperature difference; means for acquiring location information and identifying the movement route; and means for analyzing the user's emotional state using voice and biometric data and providing warnings or assistance under predetermined conditions. This comprehensively supports the user's physical and psychological safety, ensures sustained power even during prolonged activity, and enables a rapid response in emergencies.

[0146] "User" refers to a person who uses the system in this invention, and includes those who engage in outdoor activities such as mountain climbing.

[0147] "Body temperature" refers to the temperature of the user's skin surface, and it fluctuates depending on their activity level and environment.

[0148] "Temperature difference" refers to the difference between the user's body temperature and the ambient temperature, and is used for energy conversion.

[0149] "Electricity generation" refers to the process of generating electrical energy by utilizing body temperature and the temperature difference.

[0150] "Means of storing electricity" refers to a function that holds the generated electrical energy and supplies it to other functions of the system.

[0151] "Location information" refers to data indicating the user's geographical location, and is obtained using GPS technology.

[0152] "Travel route" refers to information that shows the path or route that a user should take.

[0153] "Emotional state" refers to the user's current psychological state and feelings, and is analyzed based on voice and biometric data.

[0154] "Warning or assistance" refers to information or instructions provided in accordance with the user's condition, including support to improve the situation.

[0155] The system of the present invention is a comprehensive support device for ensuring the safety of outdoor activity participants, including mountain climbers. This device mainly includes the following components.

[0156] The server receives data from a terminal equipped with a sensor that continuously monitors the user's body temperature. This body temperature data is converted into electricity using a thermoelectric conversion module in the terminal and stored in the device's battery. This ensures that power is maintained even during prolonged use, allowing the user to use the terminal without worrying about the battery running out.

[0157] The device utilizes a high-precision GPS module to acquire the user's location information in real time. This location data is linked with built-in digital map software to display the user's current location and provide guidance on recommended routes. Users can use these navigation functions to safely select a route to their destination and continue their hike.

[0158] When a user presses the designated SOS button on their device, the device quickly sends their current location and health data to a server. This data is automatically sent to pre-registered emergency contacts, ensuring a swift rescue operation.

[0159] A device equipped with emotion analysis capabilities uses a built-in voice recognition module and biosensors to analyze the user's voice and facial expressions to understand their emotional state. If abnormal stress or anxiety is detected, the device will display a message encouraging the user to relax or provide voice guidance. In particular, if a sudden change in emotion is detected, the information is immediately sent to a server, and external notifications will be issued as needed.

[0160] For example, if a user feels anxious on a steep mountain path, the emotion analysis function can detect this state. This allows the device to display a message such as, "You are safe, please relax." Furthermore, notifying family members of the situation enables additional support from outside.

[0161] An example of a prompt for a generative AI model is: "Please suggest a relaxing message to send to a user who feels anxious while hiking. The message should be short and warm."

[0162] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0163] Step 1:

[0164] The device continuously measures the user's body temperature using sensors. The input is the user's skin temperature data, and based on this data, the device calculates the temperature difference between the skin temperature and the ambient temperature. This calculated temperature difference is converted into electricity by a thermoelectric conversion module and stored in the internal battery. This electricity provides the power to continuously operate the device's other functions.

[0165] Step 2:

[0166] The device uses a GPS module to obtain the user's current location information. The input here is a signal from GPS satellites, which the device uses to calculate the user's latitude and longitude. The calculation results are sent to digital mapping software, where they are integrated with map data. This process displays the user's current location and provides recommended directions.

[0167] Step 3:

[0168] When a user presses the SOS button on their device, the device immediately sends the user's current location and health data to the server. The inputs for this step are the user's button press and real-time health data. The server receives this data and takes action to notify pre-registered emergency contacts. The output is a notification of location and health information to the emergency contacts.

[0169] Step 4:

[0170] The device monitors the user's emotional state using a built-in voice recognition module and biosensors. The user's voice tone and facial expression data are used as input and processed by an emotion analysis algorithm. Based on this analysis, if stress or anxiety is detected, the device outputs a message to the user, such as "Try to relax," either by displaying it or playing an audio message.

[0171] Step 5:

[0172] If the emotion analysis detects a sudden change in emotion, the device sends that data to the server. The input for this step is emotion change data, which is sent to the server, which then processes the data to notify external parties of the situation. The output is a notification of the change in emotional state to emergency contacts. This process allows those around the person to understand the situation and provide support as needed.

[0173] (Application Example 2)

[0174] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0175] Ensuring the safety of workers in industrial settings is crucial, but preventing accidents and decreased efficiency caused by worker stress and emotional fluctuations is challenging. This invention aims to provide a system that utilizes workers' biosignals to manage safety and psychological state, enabling rapid response and the provision of an appropriate work environment in emergencies.

[0176] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0177] In this invention, the server includes means for detecting biosignals and storing power, guidance means for acquiring location information and identifying a movement path, emergency communication means for transmitting current location information and health information to an external party in an emergency, emotion detection means for determining the emotional state of a worker in real time, and instruction / notification means for providing instructions and notifying an external party when the emotional state is abnormal. This makes it possible to comprehensively monitor and manage the safety and mental health of workers.

[0178] "Biosignals" refer to data obtained by detecting various physical, chemical, and electrical phenomena generated from the human body.

[0179] "Storing electricity" means preserving energy and making it available for efficient extraction when needed.

[0180] "Location information" refers to data that indicates the geographical location where an object or individual exists.

[0181] "Guidance means" refers to devices or procedures used to guide an object to its destination via a specific route or method.

[0182] "Emergency communication" refers to a means of communication used to quickly and appropriately transmit information to external parties in a critical situation.

[0183] "Emotional state" refers to an individual's mental or psychological state or mood, and includes various elements such as stress, joy, and excitement.

[0184] "Emotion detection" is the process of identifying the type and changes in an individual's emotions from data such as voice, facial expressions, and biometric information.

[0185] A "means of instruction or notification" refers to a method or mechanism for conveying specific information to another entity.

[0186] The system for realizing this invention provides a smart helmet for comprehensively managing the safety and health of employees in industrial settings. The smart helmet can detect the user's biosignals to store power and acquire location information using a GPS module to provide accurate guidance.

[0187] The helmet is equipped with a voice recognition device and biometric data sensors as means of emotion detection, determining the worker's emotional state in real time. This allows it to provide instructions via the helmet's display or voice prompts if stress or anxiety is detected, and to notify remote managers via emergency communication systems in case of abnormalities.

[0188] The specific hardware includes temperature sensors, GPS modules, microphones, and biosensors. The software utilizes a machine learning model based on TENSORFLOW® for real-time emotion detection. Additionally, AWS® services are used to send collected data to the cloud for quick access when needed.

[0189] For example, if a worker notices an unusual noise while operating machinery, an increase in stress can be detected from their tone of voice. In this case, the helmet will display an appropriate alert and, if necessary, warn the manager. This information is stored on a management server and can be used later to devise measures to improve safety.

[0190] Examples of prompts for a generative AI model include the following:

[0191] "Please show how to process voice input to analyze changes in stress levels and suggest recommended safety measures."

[0192] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0193] Step 1:

[0194] When the device is powered on, a temperature sensor constantly monitors the user's body temperature. Using the input biometric data, it detects temperature differences and supplies power to the energy storage device. This allows the device to be used for extended periods.

[0195] Step 2:

[0196] The GPS module in the device continuously acquires the user's location information and determines the current location by referring to a geographic database. Based on this, it calculates a travel route and provides appropriate guidance. Specifically, it instructs the user on the next action via voice or AR display.

[0197] Step 3:

[0198] The device analyzes the user's emotional state in real time using voice recognition and biosensors. It takes voice data, heart rate, and temperature data as input and uses a generative AI model to detect stress and anxiety. If an abnormality is detected, it issues a warning to the user via voice or visual message.

[0199] Step 4:

[0200] If the device detects an abnormal emotional state, it prepares to send the collected data to the server. The data is sent to the server and made accessible to the administrator. The data includes location information, health status, and sentiment analysis results.

[0201] Step 5:

[0202] If a user determines an emergency is occurring and activates emergency communication, the device immediately sends location and health data to the server. The server receives this data and notifies pre-configured emergency contacts. The notification includes the user's situation and recommended actions.

[0203] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0204] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0205] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0206] [Second Embodiment]

[0207] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0208] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0209] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0210] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0211] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0212] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0213] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0214] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0215] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0216] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0217] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0218] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0219] This invention provides a device that functions as a system to support mountain climbers in safely climbing mountains. This device is equipped with a means of sustained power generation using body heat, GPS-based navigation, and emergency communication means. It also has a function to automatically manage the status when entering and descending a mountain and notify the user and related parties of the information.

[0220] Program Processing Description

[0221] The device constantly detects the user's body temperature using sensors, generates power using the temperature difference, and stores it in the battery. This plays a crucial role in preventing the device from running out of battery.

[0222] The device uses GPS to determine the user's location and navigates the hiking route based on surrounding terrain data. While walking, the user receives real-time location information and directional guidance through the device's screen, enabling safe route selection.

[0223] In an emergency, pressing the SOS button on the device immediately sends information about the user's current location and health status to the server. Upon receiving this information, the server automatically notifies registered emergency contacts and arranges for the user to receive the necessary assistance.

[0224] Furthermore, the device automatically recognizes beacons installed at the trailhead and exit point, recording the user's entry and exit from the mountain. The server manages this data and notifies family members and relevant parties of the progress. This allows for real-time monitoring of the user's climbing status.

[0225] As a concrete example, when a user begins climbing a mountain, the device provides an appropriate climbing route and tracks progress in real time. In the event of any health problems, the abnormality detection function activates and immediate action is taken. Upon completion of the climb, the device recognizes the descent beacon, completes the recording, and automatically notifies the user's family of the entire climbing process. In this way, the present invention makes mountain climbing a safer and more secure activity.

[0226] The following describes the processing flow.

[0227] Step 1:

[0228] The device periodically measures the user's skin temperature using a body temperature sensor and detects changes in that temperature. At the same time, it also measures the ambient temperature and calculates the temperature difference.

[0229] Step 2:

[0230] The device performs thermal-electric conversion based on the measured temperature difference, generating power and storing it in the battery. This process enables the device to have a continuous power supply.

[0231] Step 3:

[0232] The device uses a GPS module to periodically obtain its current geographical location and uses that information to display the climber's current location on a map.

[0233] Step 4:

[0234] Users can check their current location and recommended route information through the device's interface and follow a safe hiking route by moving in the indicated direction.

[0235] Step 5:

[0236] The device monitors health and activity levels, such as abnormal heart rate and movement speed, and immediately reports any abnormalities to the server.

[0237] Step 6:

[0238] If a user experiences an emergency, pressing the SOS button on their device will automatically send their location and health data to the server.

[0239] Step 7:

[0240] Based on the emergency information received from the terminal, the server quickly sends notifications to pre-configured emergency contacts and initiates necessary rescue arrangements.

[0241] Step 8:

[0242] During ascent and descent, the device detects beacon signals and automatically updates and records the user's entry or descent status based on those signals.

[0243] Step 9:

[0244] The server stores data on entering and descending the mountain in the cloud and notifies the user's family and registered contacts about the progress, allowing them to keep track of the user's status.

[0245] (Example 1)

[0246] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0247] Mountain climbing in mountainous areas involves harsh natural conditions and carries a high risk of getting lost or injured. Therefore, maintaining power levels, accurately tracking location information, and responding quickly in emergencies are essential for safe climbing. Furthermore, accurately recording the start and end of climbs and coordinating smoothly with external parties are also required, but only a limited number of systems can efficiently handle these tasks.

[0248] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0249] In this invention, the server includes means for detecting the user's body temperature, generating power using the temperature difference, and storing it in a power supply device; navigation means for acquiring location information and guiding the user's route based on topographic information; and emergency communication means for transmitting the user's current location and health information to a central device in an emergency. This enables the maintenance of an appropriate amount of power at all times, optimal route guidance based on location information, and rapid emergency response. Furthermore, by providing management means that automatically record the status at the start and end of a climb and notify the information to a recording medium and relevant parties, the progress of the climb can be accurately grasped, enabling safe climbing.

[0250] "User" refers to an individual who uses this system to climb mountains.

[0251] "Body temperature" refers to the temperature maintained by the human body, and it provides an energy source for generating electricity.

[0252] "Generating electricity" means creating electrical energy by utilizing the temperature difference obtained from a sensor.

[0253] A "power supply unit" is a device for storing and supplying generated electricity.

[0254] "Location information" refers to geographical location data identified using positioning technologies such as GPS.

[0255] "Topographical information" refers to data about the topography and geographical characteristics of a region, and forms the basis for route guidance.

[0256] "Navigation methods" refer to techniques used to guide climbers based on location and topographical information.

[0257] "Emergency communication means" refers to communication methods used to transmit current location and health information to external devices in times of emergency.

[0258] The term "central system" refers to an external management system that receives information via emergency communication means.

[0259] "Recording the status" refers to the act of automatically writing down information about the start and end of a mountain climb.

[0260] A "recording medium" refers to a device or means used to store information.

[0261] "Related parties" refers to individuals or organizations, such as family members or rescue teams, who are involved in ensuring the safety of the user.

[0262] This invention is a system designed to enable mountain climbers to perform their activities safely and efficiently. The system primarily consists of a power generation device that utilizes the user's body heat, a navigation system based on location information, an emergency communication system, and a beacon detection device for automatically recording and managing the system's status.

[0263] The device uses sensors to detect the user's body temperature in real time, generates power from the temperature difference using a Peltier element, and stores that power in the battery. As a result, the device has less to worry about running out of battery and can be used for extended periods.

[0264] The device uses a GPS module to acquire location information and calculates the optimal route based on the acquired coordinate data and terrain data. This navigation function visually displays real-time location information and direction of travel to the user on the screen. This allows the user to choose a safe route.

[0265] In an emergency, the terminal's emergency communication system transmits the user's current location and health status to a central device. Based on this information, the server notifies registered emergency contacts and appropriate rescue organizations to ensure the user receives prompt assistance.

[0266] Furthermore, the device is equipped with a beacon detection function to automatically record the user's status at the start and end of a climb. Beacons are installed at the trailhead and the end of the climb, and the device recognizes the beacon signal and transmits the information to a server. The server uses this data to provide progress information to family members and other relevant parties, allowing for real-time management of the user's climbing status.

[0267] For example, the device is designed to operate stably even in harsh environments and can withstand rapid temperature changes in mountainous areas. Furthermore, it is designed to respond quickly if a user becomes unwell.

[0268] An example of a prompt message would be: "Using a generative AI model, please describe in detail the features of a climber support system based on GPS and body heat generation. Include specific functions and examples to ensure the user can climb safely."

[0269] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0270] Step 1:

[0271] The device continuously measures the user's body temperature using sensors. It receives data on the user's body temperature and ambient temperature as input, generates power through temperature difference calculations using a Peltier element, and stores the resulting power in a battery. This allows the device to provide continuous power for extended periods.

[0272] Step 2:

[0273] The device uses a GPS module to obtain the user's current location. It takes satellite location data as input and analyzes topographic information based on the coordinate data. As a result, it displays an appropriate hiking route and direction on the device's screen. The user is then supported in choosing a safe route based on this information.

[0274] Step 3:

[0275] If a user experiences an emergency, the device uses emergency communication to transmit the user's current location and health information to a server. This data is collected as input and transmitted wirelessly to the server. Based on the received data, the server quickly notifies registered emergency contacts and rescue organizations to arrange for user assistance.

[0276] Step 4:

[0277] The device detects beacons installed at the trailhead and exit point to recognize the start and end of the climb. It receives beacon signals as input, analyzes them to determine the climber's entry and exit status, and sends status data to a server as output, providing progress information to the user's family and related parties. This enables real-time status management, ensuring peace of mind for users.

[0278] (Application Example 1)

[0279] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".

[0280] During mountaineering activities, there is a need to provide a method that ensures the safety of users and allows external observers to check the progress in real time. Although there are individual functions such as emergency information transmission and sustainable power generation based on body temperature in conventional technologies, a system that comprehensively utilizes these functions and realizes timely information sharing between users and external observers has been insufficient. Therefore, it is desired to further improve the safety of mountaineers and their ability to respond to unexpected situations.

[0281] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0282] In this invention, the server includes means for detecting the user's body temperature, generating electricity using the temperature difference, and storing the electricity; navigation means for obtaining position information and specifying the movement route; communication means for transmitting the user's current position and health information to the outside in an emergency; management means for automatically updating the status and recording / notification information to the outside when entering and leaving the mountain; and information distribution means for sharing the progress information with external observers in real time. Thereby, while ensuring the safety of users during mountaineering, external observers can immediately grasp the situation and take necessary actions promptly.

[0283] The "means for detecting the body temperature, generating electricity using the temperature difference, and storing the electricity" is a technology for generating and storing electricity by a power generation system that uses the difference between the user's body temperature and the outside air temperature as a power source.

[0284] The "navigation means for obtaining position information and specifying the movement route" is a system that obtains the user's current geographical position using a satellite positioning system or the like and has a function of determining the movement route.

[0285] The "communication means for transmitting the current location and health information of the user to the outside in case of emergency" is a device for transmitting the location data and health-related information of the user to external rescue agencies and related persons through wireless communication or the like in an emergency situation.

[0286] The "management means for automatically updating the status and recording and notifying information to the outside when going up and down the mountain" is a system having a function of automatically checking and recording the status of going up and down the mountain when starting and completing mountain climbing, and notifying the information to an external server or related persons.

[0287] The "information distribution means for sharing the progress information with external observers in real time" is a system for transmitting the current mountain climbing situation of the user to related persons in real time using communication means such as the Internet.

[0288] The system for implementing this invention mainly consists of three elements: a terminal, a server, and a user. The terminal is carried by the user, and a device for continuously generating electricity using body temperature is installed inside. The terminal also includes a GPS module, a temperature sensor, a communication module, and a beacon sensor, and collects and processes various data through these. The generated power is stored, and each function of the terminal operates thereby.

[0289] As detailed processing of the terminal, the temperature sensor constantly monitors the body temperature, generates power with a power generation device using the temperature change, and accumulates it in the battery. The GPS module detects the current location of the user and transmits the data to the navigation software in real time. The navigation software collates with the terrain data and provides a safe mountain climbing route. The communication module transmits the location information and health status of the user to the server in case of emergency and notifies the registered related persons.

[0290] The server uses the received information to determine whether the user's safety is ensured. It also manages the entry and exit status transmitted from the device and manages a system for notifying family members and relevant parties. Real-time progress information is also aggregated on the server and shared with external observers.

[0291] As a concrete example, when a user begins a climb, the device automatically recognizes the start of the climb, provides a safe route, and sends the user's progress to the server. The user's family can check the progress in real time from home and immediately contact rescue organizations in case of an emergency. This system supports safe mountain climbing activities.

[0292] An example of a prompt message might be: "Please explain in detail how this system manages and notifies emergency information to ensure the safety of climbers."

[0293] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0294] Step 1:

[0295] The device continuously detects the user's body temperature using a temperature sensor. The input is the user's skin temperature, and the sensor records the temperature changes. The temperature difference is converted into electricity by a thermoelectric generator and stored in a battery. This process generates the necessary power and supplies it to the various functions of the device.

[0296] Step 2:

[0297] The device uses a GPS module to obtain the user's location information. The input is a signal received from GPS satellites, which is used to generate the user's latitude and longitude data. Navigation software, integrated with a topographic map, processes this data and displays the optimal hiking route and current progress. The output is navigation instructions.

[0298] Step 3:

[0299] The device's communication module activates when the user presses the SOS button in an emergency. The input is an SOS signal from the user. The user's current location and health status data are sent to a pre-registered server. The server analyzes the received data and automatically notifies emergency contacts. The output is an emergency contact.

[0300] Step 4:

[0301] The device automatically detects beacons at the trailhead or exit point and updates the entry and exit status. The input is a signal from the beacon, which is used to modify the user's status data. The server processes this data and notifies registered family members or others of the progress. The output is an entry or exit status notification.

[0302] Step 5:

[0303] The server aggregates real-time progress information sent from terminals. Inputs include real-time location and route data. This data is processed and distributed so that external observers can view the information via a web portal or mobile app. Output is the distribution of progress information.

[0304] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0305] This invention provides a system that comprehensively supports the safety of mountain climbers, including a body temperature-utilizing charging mechanism, advanced navigation, emergency communication means, and management means, as well as a device equipped with an emotion engine. The emotion engine can analyze the user's emotional state in real time and provide warnings or assistance as needed.

[0306] Program Processing Description

[0307] In this system, the terminal continuously monitors the user's body temperature, generates electricity based on the temperature difference, and continuously charges the internal battery. This ensures that there is no worry of power outage even during long-term use.

[0308] The terminal further uses the GPS function to obtain the user's accurate location information, displays the current location based on map data, and guides the recommended route. The user can confirm this information and continue climbing following a safe route.

[0309] In case of an emergency, when the user presses the SOS button on the terminal, the location information and health data are immediately sent to the server, and the server quickly notifies the emergency contacts. This enables rapid emergency response.

[0310] The emotion engine analyzes the user's emotions in real time through the voice recognition device and biosensors installed in the terminal. For example, it determines the stress level from the user's voice tone and expression, and if necessary, displays or provides a relaxation message in voice. If a sudden change in a specific emotion is detected, the situation is notified to the outside through emergency communication means.

[0311] As a specific example, when the user feels anxious during a rugged climb, the emotion engine captures the emotional change and displays a relaxation message. At the same time, if the abnormality continues, a notification is sent to the server, and family members who are at a distance can also be aware of it. In this way, the present invention comprehensively supports the physical and psychological states of climbers.

[0312] The following describes the processing flow.

[0313] Step 1:

[0314] The terminal continuously measures the user's body temperature with a sensor and generates electricity using the temperature difference. The generated electricity is stored in the battery, enabling the device to operate continuously.

[0315] Step 2:

[0316] The device uses a GPS module to collect accurate current location information and combines it with map data to provide real-time directions to the user. This allows the user to safely navigate the hiking route.

[0317] Step 3:

[0318] The device uses a built-in emotion engine to analyze the user's voice data and information from biosensors to assess the user's emotional state, such as stress or anxiety.

[0319] Step 4:

[0320] If the emotion engine determines that the user's stress level is high, the device will provide the user with relaxing messages or appropriate action suggestions via voice or screen.

[0321] Step 5:

[0322] If the device determines that the user is in an emergency situation, pressing the SOS button will cause the device to immediately send the latest location information and health-related data to the server.

[0323] Step 6:

[0324] The server receives emergency information sent from the terminal and automatically sends notifications to registered emergency contacts. This information includes the user's current location and emotional state history.

[0325] Step 7:

[0326] The terminal picks up beacon signals installed at the trailhead and exit point and automatically records the user's entry or exit status. This information is recorded and notified to relevant parties via the server.

[0327] Through these steps, the system provides comprehensive support for user safety and offers peace of mind by managing information in real time, including psychological state.

[0328] (Example 2)

[0329] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0330] Ensuring the physical and psychological safety of users is a crucial issue in mountaineering and outdoor activities. Conventional technologies struggle to maintain a continuous power supply, especially during prolonged activities, and to adequately respond to changes in users' emotional states. Furthermore, there is a need for methods to quickly and accurately communicate the situation to the outside in emergency situations.

[0331] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0332] In this invention, the server includes means for detecting the user's body temperature and generating and storing power using the temperature difference; means for acquiring location information and identifying the movement route; and means for analyzing the user's emotional state using voice and biometric data and providing warnings or assistance under predetermined conditions. This comprehensively supports the user's physical and psychological safety, ensures sustained power even during prolonged activity, and enables a rapid response in emergencies.

[0333] "User" refers to a person who uses the system in this invention, and includes those who engage in outdoor activities such as mountain climbing.

[0334] "Body temperature" refers to the temperature of the user's skin surface, and it fluctuates depending on their activity level and environment.

[0335] "Temperature difference" refers to the difference between the user's body temperature and the ambient temperature, and is used for energy conversion.

[0336] "Electricity generation" refers to the process of generating electrical energy by utilizing body temperature and the temperature difference.

[0337] "Means of storing electricity" refers to a function that holds the generated electrical energy and supplies it to other functions of the system.

[0338] "Location information" refers to data indicating the user's geographical location, and is obtained using GPS technology.

[0339] "Travel route" refers to information that shows the path or route that a user should take.

[0340] "Emotional state" refers to the user's current psychological state and feelings, and is analyzed based on voice and biometric data.

[0341] "Warning or assistance" refers to information or instructions provided in accordance with the user's condition, including support to improve the situation.

[0342] The system of the present invention is a comprehensive support device for ensuring the safety of outdoor activity participants, including mountain climbers. This device mainly includes the following components.

[0343] The server receives data from a terminal equipped with a sensor that continuously monitors the user's body temperature. This body temperature data is converted into electricity using a thermoelectric conversion module in the terminal and stored in the device's battery. This ensures that power is maintained even during prolonged use, allowing the user to use the terminal without worrying about the battery running out.

[0344] The device utilizes a high-precision GPS module to acquire the user's location information in real time. This location data is linked with built-in digital map software to display the user's current location and provide guidance on recommended routes. Users can use these navigation functions to safely select a route to their destination and continue their hike.

[0345] When a user presses the designated SOS button on their device, the device quickly sends their current location and health data to a server. This data is automatically sent to pre-registered emergency contacts, ensuring a swift rescue operation.

[0346] A device equipped with emotion analysis capabilities uses a built-in voice recognition module and biosensors to analyze the user's voice and facial expressions to understand their emotional state. If abnormal stress or anxiety is detected, the device will display a message encouraging the user to relax or provide voice guidance. In particular, if a sudden change in emotion is detected, the information is immediately sent to a server, and external notifications will be issued as needed.

[0347] For example, if a user feels anxious on a steep mountain path, the emotion analysis function can detect this state. This allows the device to display a message such as, "You are safe, please relax." Furthermore, notifying family members of the situation enables additional support from outside.

[0348] An example of a prompt for a generative AI model is: "Please suggest a relaxing message to send to a user who feels anxious while hiking. The message should be short and warm."

[0349] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0350] Step 1:

[0351] The device continuously measures the user's body temperature using sensors. The input is the user's skin temperature data, and based on this data, the device calculates the temperature difference between the skin temperature and the ambient temperature. This calculated temperature difference is converted into electricity by a thermoelectric conversion module and stored in the internal battery. This electricity provides the power to continuously operate the device's other functions.

[0352] Step 2:

[0353] The device uses a GPS module to obtain the user's current location information. The input here is a signal from GPS satellites, which the device uses to calculate the user's latitude and longitude. The calculation results are sent to digital mapping software, where they are integrated with map data. This process displays the user's current location and provides recommended directions.

[0354] Step 3:

[0355] When a user presses the SOS button on their device, the device immediately sends the user's current location and health data to the server. The inputs for this step are the user's button press and real-time health data. The server receives this data and takes action to notify pre-registered emergency contacts. The output is a notification of location and health information to the emergency contacts.

[0356] Step 4:

[0357] The device monitors the user's emotional state using a built-in voice recognition module and biosensors. The user's voice tone and facial expression data are used as input and processed by an emotion analysis algorithm. Based on this analysis, if stress or anxiety is detected, the device outputs a message to the user, such as "Try to relax," either by displaying it or playing an audio message.

[0358] Step 5:

[0359] If the emotion analysis detects a sudden change in emotion, the device sends that data to the server. The input for this step is emotion change data, which is sent to the server, which then processes the data to notify external parties of the situation. The output is a notification of the change in emotional state to emergency contacts. This process allows those around the person to understand the situation and provide support as needed.

[0360] (Application Example 2)

[0361] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0362] Ensuring the safety of workers in industrial settings is crucial, but preventing accidents and decreased efficiency caused by worker stress and emotional fluctuations is challenging. This invention aims to provide a system that utilizes workers' biosignals to manage safety and psychological state, enabling rapid response and the provision of an appropriate work environment in emergencies.

[0363] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0364] In this invention, the server includes means for detecting biosignals and storing power, guidance means for acquiring location information and identifying a movement path, emergency communication means for transmitting current location information and health information to an external party in an emergency, emotion detection means for determining the emotional state of a worker in real time, and instruction / notification means for providing instructions and notifying an external party when the emotional state is abnormal. This makes it possible to comprehensively monitor and manage the safety and mental health of workers.

[0365] "Biosignals" refer to data obtained by detecting various physical, chemical, and electrical phenomena generated from the human body.

[0366] "Storing electricity" means preserving energy and making it available for efficient extraction when needed.

[0367] "Location information" refers to data that indicates the geographical location where an object or individual exists.

[0368] "Guidance means" refers to devices or procedures used to guide an object to its destination via a specific route or method.

[0369] "Emergency communication" refers to a means of communication used to quickly and appropriately transmit information to external parties in a critical situation.

[0370] "Emotional state" refers to an individual's mental or psychological state or mood, and includes various elements such as stress, joy, and excitement.

[0371] "Emotion detection" is the process of identifying the type and changes in an individual's emotions from data such as voice, facial expressions, and biometric information.

[0372] A "means of instruction or notification" refers to a method or mechanism for conveying specific information to another entity.

[0373] The system for realizing this invention provides a smart helmet for comprehensively managing the safety and health of employees in industrial settings. The smart helmet can detect the user's biosignals to store power and acquire location information using a GPS module to provide accurate guidance.

[0374] The helmet is equipped with a voice recognition device and biometric data sensors as means of emotion detection, determining the worker's emotional state in real time. This allows it to provide instructions via the helmet's display or voice prompts if stress or anxiety is detected, and to notify remote managers via emergency communication systems in case of abnormalities.

[0375] The specific hardware includes temperature sensors, GPS modules, microphones, and biosensors. The software utilizes a machine learning model based on TensorFlow for real-time emotion detection. Additionally, AWS services are used to send collected data to the cloud, ensuring quick access when needed.

[0376] For example, if a worker notices an unusual noise while operating machinery, an increase in stress can be detected from their tone of voice. In this case, the helmet will display an appropriate alert and, if necessary, warn the manager. This information is stored on a management server and can be used later to devise measures to improve safety.

[0377] Examples of prompts for a generative AI model include the following:

[0378] "Please show how to process voice input to analyze changes in stress levels and suggest recommended safety measures."

[0379] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0380] Step 1:

[0381] When the device is powered on, a temperature sensor constantly monitors the user's body temperature. Using the input biometric data, it detects temperature differences and supplies power to the energy storage device. This allows the device to be used for extended periods.

[0382] Step 2:

[0383] The GPS module in the device continuously acquires the user's location information and determines the current location by referring to a geographic database. Based on this, it calculates a travel route and provides appropriate guidance. Specifically, it instructs the user on the next action via voice or AR display.

[0384] Step 3:

[0385] The device analyzes the user's emotional state in real time using voice recognition and biosensors. It takes voice data, heart rate, and temperature data as input and uses a generative AI model to detect stress and anxiety. If an abnormality is detected, it issues a warning to the user via voice or visual message.

[0386] Step 4:

[0387] If the device detects an abnormal emotional state, it prepares to send the collected data to the server. The data is sent to the server and made accessible to the administrator. The data includes location information, health status, and sentiment analysis results.

[0388] Step 5:

[0389] If a user determines an emergency is occurring and activates emergency communication, the device immediately sends location and health data to the server. The server receives this data and notifies pre-configured emergency contacts. The notification includes the user's situation and recommended actions.

[0390] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0391] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0392] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0393] [Third Embodiment]

[0394] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0395] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0396] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0397] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0398] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0399] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0400] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0401] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0402] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0403] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0404] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0405] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0406] This invention provides a device that functions as a system to support mountain climbers in safely climbing mountains. This device is equipped with a means of sustained power generation using body heat, GPS-based navigation, and emergency communication means. It also has a function to automatically manage the status when entering and descending a mountain and notify the user and related parties of the information.

[0407] Program Processing Description

[0408] The device constantly detects the user's body temperature using sensors, generates power using the temperature difference, and stores it in the battery. This plays a crucial role in preventing the device from running out of battery.

[0409] The device uses GPS to determine the user's location and navigates the hiking route based on surrounding terrain data. While walking, the user receives real-time location information and directional guidance through the device's screen, enabling safe route selection.

[0410] In an emergency, pressing the SOS button on the device immediately sends information about the user's current location and health status to the server. Upon receiving this information, the server automatically notifies registered emergency contacts and arranges for the user to receive the necessary assistance.

[0411] Furthermore, the device automatically recognizes beacons installed at the trailhead and exit point, recording the user's entry and exit from the mountain. The server manages this data and notifies family members and relevant parties of the progress. This allows for real-time monitoring of the user's climbing status.

[0412] As a concrete example, when a user begins climbing a mountain, the device provides an appropriate climbing route and tracks progress in real time. In the event of any health problems, the abnormality detection function activates and immediate action is taken. Upon completion of the climb, the device recognizes the descent beacon, completes the recording, and automatically notifies the user's family of the entire climbing process. In this way, the present invention makes mountain climbing a safer and more secure activity.

[0413] The following describes the processing flow.

[0414] Step 1:

[0415] The device periodically measures the user's skin temperature using a body temperature sensor and detects changes in that temperature. At the same time, it also measures the ambient temperature and calculates the temperature difference.

[0416] Step 2:

[0417] The device performs thermal-electric conversion based on the measured temperature difference, generating power and storing it in the battery. This process enables the device to have a continuous power supply.

[0418] Step 3:

[0419] The device uses a GPS module to periodically obtain its current geographical location and uses that information to display the climber's current location on a map.

[0420] Step 4:

[0421] Users can check their current location and recommended route information through the device's interface and follow a safe hiking route by moving in the indicated direction.

[0422] Step 5:

[0423] The device monitors health and activity levels, such as abnormal heart rate and movement speed, and immediately reports any abnormalities to the server.

[0424] Step 6:

[0425] If a user experiences an emergency, pressing the SOS button on their device will automatically send their location and health data to the server.

[0426] Step 7:

[0427] Based on the emergency information received from the terminal, the server quickly sends notifications to pre-configured emergency contacts and initiates necessary rescue arrangements.

[0428] Step 8:

[0429] During ascent and descent, the device detects beacon signals and automatically updates and records the user's entry or descent status based on those signals.

[0430] Step 9:

[0431] The server stores data on entering and descending the mountain in the cloud and notifies the user's family and registered contacts about the progress, allowing them to keep track of the user's status.

[0432] (Example 1)

[0433] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0434] Mountain climbing in mountainous areas involves harsh natural conditions and carries a high risk of getting lost or injured. Therefore, maintaining power levels, accurately tracking location information, and responding quickly in emergencies are essential for safe climbing. Furthermore, accurately recording the start and end of climbs and coordinating smoothly with external parties are also required, but only a limited number of systems can efficiently handle these tasks.

[0435] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0436] In this invention, the server includes means for detecting the user's body temperature, generating power using the temperature difference, and storing it in a power supply device; navigation means for acquiring location information and guiding the user's route based on topographic information; and emergency communication means for transmitting the user's current location and health information to a central device in an emergency. This enables the maintenance of an appropriate amount of power at all times, optimal route guidance based on location information, and rapid emergency response. Furthermore, by providing management means that automatically record the status at the start and end of a climb and notify the information to a recording medium and relevant parties, the progress of the climb can be accurately grasped, enabling safe climbing.

[0437] "User" refers to an individual who uses this system to climb mountains.

[0438] "Body temperature" refers to the temperature maintained by the human body, and it provides an energy source for generating electricity.

[0439] "Generating electricity" means creating electrical energy by utilizing the temperature difference obtained from a sensor.

[0440] A "power supply unit" is a device for storing and supplying generated electricity.

[0441] "Location information" refers to geographical location data identified using positioning technologies such as GPS.

[0442] "Topographical information" refers to data about the topography and geographical characteristics of a region, and forms the basis for route guidance.

[0443] "Navigation methods" refer to techniques used to guide climbers based on location and topographical information.

[0444] "Emergency communication means" refers to communication methods used to transmit current location and health information to external devices in times of emergency.

[0445] The term "central system" refers to an external management system that receives information via emergency communication means.

[0446] "Recording the status" refers to the act of automatically writing down information about the start and end of a mountain climb.

[0447] A "recording medium" refers to a device or means used to store information.

[0448] "Related parties" refers to individuals or organizations, such as family members or rescue teams, who are involved in ensuring the safety of the user.

[0449] This invention is a system designed to enable mountain climbers to perform their activities safely and efficiently. The system primarily consists of a power generation device that utilizes the user's body heat, a navigation system based on location information, an emergency communication system, and a beacon detection device for automatically recording and managing the system's status.

[0450] The device uses sensors to detect the user's body temperature in real time, generates power from the temperature difference using a Peltier element, and stores that power in the battery. As a result, the device has less to worry about running out of battery and can be used for extended periods.

[0451] The device uses a GPS module to acquire location information and calculates the optimal route based on the acquired coordinate data and terrain data. This navigation function visually displays real-time location information and direction of travel to the user on the screen. This allows the user to choose a safe route.

[0452] In an emergency, the terminal's emergency communication system transmits the user's current location and health status to a central device. Based on this information, the server notifies registered emergency contacts and appropriate rescue organizations to ensure the user receives prompt assistance.

[0453] Furthermore, the device is equipped with a beacon detection function to automatically record the user's status at the start and end of a climb. Beacons are installed at the trailhead and the end of the climb, and the device recognizes the beacon signal and transmits the information to a server. The server uses this data to provide progress information to family members and other relevant parties, allowing for real-time management of the user's climbing status.

[0454] For example, the device is designed to operate stably even in harsh environments and can withstand rapid temperature changes in mountainous areas. Furthermore, it is designed to respond quickly if a user becomes unwell.

[0455] An example of a prompt message would be: "Using a generative AI model, please describe in detail the features of a climber support system based on GPS and body heat generation. Include specific functions and examples to ensure the user can climb safely."

[0456] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0457] Step 1:

[0458] The device continuously measures the user's body temperature using sensors. It receives data on the user's body temperature and ambient temperature as input, generates power through temperature difference calculations using a Peltier element, and stores the resulting power in a battery. This allows the device to provide continuous power for extended periods.

[0459] Step 2:

[0460] The device uses a GPS module to obtain the user's current location. It takes satellite location data as input and analyzes topographic information based on the coordinate data. As a result, it displays an appropriate hiking route and direction on the device's screen. The user is then supported in choosing a safe route based on this information.

[0461] Step 3:

[0462] If a user experiences an emergency, the device uses emergency communication to transmit the user's current location and health information to a server. This data is collected as input and transmitted wirelessly to the server. Based on the received data, the server quickly notifies registered emergency contacts and rescue organizations to arrange for user assistance.

[0463] Step 4:

[0464] The device detects beacons installed at the trailhead and exit point to recognize the start and end of the climb. It receives beacon signals as input, analyzes them to determine the climber's entry and exit status, and sends status data to a server as output, providing progress information to the user's family and related parties. This enables real-time status management, ensuring peace of mind for users.

[0465] (Application Example 1)

[0466] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0467] During mountaineering activities, there is a need to ensure the safety of users while providing a method for external observers to monitor progress in real time. While conventional technologies offer individual functions such as emergency information transmission and continuous power generation using body heat, they lack a comprehensive system that effectively utilizes these functions to facilitate timely information sharing between users and external observers. Therefore, there is a strong desire to further improve the safety of mountaineers and their ability to respond to unforeseen circumstances.

[0468] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0469] In this invention, the server includes means for detecting the user's body temperature, generating electricity using the temperature difference, and storing power; navigation means for acquiring location information and identifying the travel route; communication means for transmitting the user's current location and health information to an external party in an emergency; management means for automatically updating the status when entering and descending a mountain, and recording and notifying the information to an external party; and information distribution means for sharing progress information with external observers in real time. This ensures the safety of users during mountain climbing, and allows external observers to immediately grasp the situation and take necessary actions quickly.

[0470] "A means of detecting body temperature, generating electricity using the temperature difference, and storing electricity" refers to a technology that generates and stores electricity using a power generation system that uses the difference between the user's body temperature and the ambient temperature as a power source.

[0471] A "navigation means for acquiring location information and determining a travel route" is a system that has the function of acquiring the user's current geographical location using a satellite positioning system or the like and determining a travel route.

[0472] "A communication means for transmitting the user's current location and health information to an external party in an emergency" refers to a device that transmits the user's location data and health information to external rescue organizations and related parties via wireless communication or other means in the event of an emergency.

[0473] A "management system that automatically updates status upon entering and descending a mountain and records and notifies information externally" refers to a system equipped with the function of automatically checking and recording the status of entering and descending a mountain when a climb is started and completed, and notifying an external server or relevant parties of that information.

[0474] "Information distribution method for sharing progress information with external observers in real time" refers to a system that transmits the user's current climbing status to relevant parties in real time using communication methods such as the internet.

[0475] The system implementing this invention mainly consists of three elements: a terminal, a server, and a user. The terminal is carried by the user and contains a device that continuously generates electricity using body heat. The terminal also has a GPS module, a temperature sensor, a communication module, and a beacon sensor, which collect and process various data. The generated power is stored, and this power operates the various functions of the terminal.

[0476] The device's detailed processing includes a temperature sensor that constantly monitors body temperature, using the temperature changes to generate power in a power generator and store it in a battery. A GPS module detects the user's current location and transmits this data to navigation software in real time. The navigation software compares this data with terrain data to provide a safe hiking route. In emergencies, a communication module transmits the user's location and health status to a server and notifies registered contacts.

[0477] The server uses the received information to determine whether the user's safety is ensured. It also manages the entry and exit status transmitted from the device and manages a system for notifying family members and relevant parties. Real-time progress information is also aggregated on the server and shared with external observers.

[0478] As a concrete example, when a user begins a climb, the device automatically recognizes the start of the climb, provides a safe route, and sends the user's progress to the server. The user's family can check the progress in real time from home and immediately contact rescue organizations in case of an emergency. This system supports safe mountain climbing activities.

[0479] An example of a prompt message might be: "Please explain in detail how this system manages and notifies emergency information to ensure the safety of climbers."

[0480] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0481] Step 1:

[0482] The device continuously detects the user's body temperature using a temperature sensor. The input is the user's skin temperature, and the sensor records the temperature changes. The temperature difference is converted into electricity by a thermoelectric generator and stored in a battery. This process generates the necessary power and supplies it to the various functions of the device.

[0483] Step 2:

[0484] The device uses a GPS module to obtain the user's location information. The input is a signal received from GPS satellites, which is used to generate the user's latitude and longitude data. Navigation software, integrated with a topographic map, processes this data and displays the optimal hiking route and current progress. The output is navigation instructions.

[0485] Step 3:

[0486] The device's communication module activates when the user presses the SOS button in an emergency. The input is an SOS signal from the user. The user's current location and health status data are sent to a pre-registered server. The server analyzes the received data and automatically notifies emergency contacts. The output is an emergency contact.

[0487] Step 4:

[0488] The device automatically detects beacons at the trailhead or exit point and updates the entry and exit status. The input is a signal from the beacon, which is used to modify the user's status data. The server processes this data and notifies registered family members or others of the progress. The output is an entry or exit status notification.

[0489] Step 5:

[0490] The server aggregates real-time progress information sent from terminals. Inputs include real-time location and route data. This data is processed and distributed so that external observers can view the information via a web portal or mobile app. Output is the distribution of progress information.

[0491] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0492] This invention provides a system that comprehensively supports the safety of mountain climbers, including a body temperature-utilizing charging mechanism, advanced navigation, emergency communication means, and management means, as well as a device equipped with an emotion engine. The emotion engine can analyze the user's emotional state in real time and provide warnings or assistance as needed.

[0493] Program Processing Description

[0494] In this system, the device constantly monitors the user's body temperature, generates power based on the temperature difference, and continuously charges the internal battery. This eliminates concerns about running out of power even during prolonged use.

[0495] The device further uses GPS functionality to obtain the user's precise location, displays their current location based on map data, and guides them along a recommended route. Users can then review this information and continue their climb following a safe route.

[0496] In an emergency, pressing the SOS button on the device instantly sends location and health data to a server, which then quickly notifies emergency contacts. This allows for a rapid response to the emergency.

[0497] The emotion engine analyzes the user's emotions in real time using voice recognition devices and biosensors installed in the device. For example, it determines the stress level from the user's tone of voice and facial expressions, and if necessary, provides relaxing messages via display or voice. If a sudden change in a particular emotion is detected, it notifies an external party of the situation through emergency communication channels.

[0498] As a concrete example, when a user feels anxious during a challenging climb, the emotion engine detects this change in emotion and displays a relaxing message. Simultaneously, if the abnormality persists, a notification is sent to the server, allowing family members in remote locations to be aware of it. In this form, the present invention comprehensively supports the physical and psychological state of climbers.

[0499] The following describes the processing flow.

[0500] Step 1:

[0501] The device continuously measures the user's body temperature using sensors and generates power using the temperature difference. This generated power is stored in the battery, enabling the device to operate continuously.

[0502] Step 2:

[0503] The device uses a GPS module to collect accurate current location information and combines it with map data to provide real-time directions to the user. This allows the user to safely navigate the hiking route.

[0504] Step 3:

[0505] The device uses a built-in emotion engine to analyze the user's voice data and information from biosensors to assess the user's emotional state, such as stress or anxiety.

[0506] Step 4:

[0507] If the emotion engine determines that the user's stress level is high, the device will provide the user with relaxing messages or appropriate action suggestions via voice or screen.

[0508] Step 5:

[0509] If the device determines that the user is in an emergency situation, pressing the SOS button will cause the device to immediately send the latest location information and health-related data to the server.

[0510] Step 6:

[0511] The server receives emergency information sent from the terminal and automatically sends notifications to registered emergency contacts. This information includes the user's current location and emotional state history.

[0512] Step 7:

[0513] The terminal picks up beacon signals installed at the trailhead and exit point and automatically records the user's entry or exit status. This information is recorded and notified to relevant parties via the server.

[0514] Through these steps, the system provides comprehensive support for user safety and offers peace of mind by managing information in real time, including psychological state.

[0515] (Example 2)

[0516] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0517] Ensuring the physical and psychological safety of users is a crucial issue in mountaineering and outdoor activities. Conventional technologies struggle to maintain a continuous power supply, especially during prolonged activities, and to adequately respond to changes in users' emotional states. Furthermore, there is a need for methods to quickly and accurately communicate the situation to the outside in emergency situations.

[0518] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0519] In this invention, the server includes means for detecting the user's body temperature and generating and storing power using the temperature difference; means for acquiring location information and identifying the movement route; and means for analyzing the user's emotional state using voice and biometric data and providing warnings or assistance under predetermined conditions. This comprehensively supports the user's physical and psychological safety, ensures sustained power even during prolonged activity, and enables a rapid response in emergencies.

[0520] "User" refers to a person who uses the system in this invention, and includes those who engage in outdoor activities such as mountain climbing.

[0521] "Body temperature" refers to the temperature of the user's skin surface, and it fluctuates depending on their activity level and environment.

[0522] "Temperature difference" refers to the difference between the user's body temperature and the ambient temperature, and is used for energy conversion.

[0523] "Electricity generation" refers to the process of generating electrical energy by utilizing body temperature and the temperature difference.

[0524] "Means of storing electricity" refers to a function that holds the generated electrical energy and supplies it to other functions of the system.

[0525] "Location information" refers to data indicating the user's geographical location, and is obtained using GPS technology.

[0526] "Travel route" refers to information that shows the path or route that a user should take.

[0527] "Emotional state" refers to the user's current psychological state and feelings, and is analyzed based on voice and biometric data.

[0528] "Warning or assistance" refers to information or instructions provided in accordance with the user's condition, including support to improve the situation.

[0529] The system of the present invention is a comprehensive support device for ensuring the safety of outdoor activity participants, including mountain climbers. This device mainly includes the following components.

[0530] The server receives data from a terminal equipped with a sensor that continuously monitors the user's body temperature. This body temperature data is converted into electricity using a thermoelectric conversion module in the terminal and stored in the device's battery. This ensures that power is maintained even during prolonged use, allowing the user to use the terminal without worrying about the battery running out.

[0531] The device utilizes a high-precision GPS module to acquire the user's location information in real time. This location data is linked with built-in digital map software to display the user's current location and provide guidance on recommended routes. Users can use these navigation functions to safely select a route to their destination and continue their hike.

[0532] When a user presses the designated SOS button on their device, the device quickly sends their current location and health data to a server. This data is automatically sent to pre-registered emergency contacts, ensuring a swift rescue operation.

[0533] A device equipped with emotion analysis capabilities uses a built-in voice recognition module and biosensors to analyze the user's voice and facial expressions to understand their emotional state. If abnormal stress or anxiety is detected, the device will display a message encouraging the user to relax or provide voice guidance. In particular, if a sudden change in emotion is detected, the information is immediately sent to a server, and external notifications will be issued as needed.

[0534] For example, if a user feels anxious on a steep mountain path, the emotion analysis function can detect this state. This allows the device to display a message such as, "You are safe, please relax." Furthermore, notifying family members of the situation enables additional support from outside.

[0535] An example of a prompt for a generative AI model is: "Please suggest a relaxing message to send to a user who feels anxious while hiking. The message should be short and warm."

[0536] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0537] Step 1:

[0538] The device continuously measures the user's body temperature using sensors. The input is the user's skin temperature data, and based on this data, the device calculates the temperature difference between the skin temperature and the ambient temperature. This calculated temperature difference is converted into electricity by a thermoelectric conversion module and stored in the internal battery. This electricity provides the power to continuously operate the device's other functions.

[0539] Step 2:

[0540] The device uses a GPS module to obtain the user's current location information. The input here is a signal from GPS satellites, which the device uses to calculate the user's latitude and longitude. The calculation results are sent to digital mapping software, where they are integrated with map data. This process displays the user's current location and provides recommended directions.

[0541] Step 3:

[0542] When a user presses the SOS button on their device, the device immediately sends the user's current location and health data to the server. The inputs for this step are the user's button press and real-time health data. The server receives this data and takes action to notify pre-registered emergency contacts. The output is a notification of location and health information to the emergency contacts.

[0543] Step 4:

[0544] The device monitors the user's emotional state using a built-in voice recognition module and biosensors. The user's voice tone and facial expression data are used as input and processed by an emotion analysis algorithm. Based on this analysis, if stress or anxiety is detected, the device outputs a message to the user, such as "Try to relax," either by displaying it or playing an audio message.

[0545] Step 5:

[0546] If the emotion analysis detects a sudden change in emotion, the device sends that data to the server. The input for this step is emotion change data, which is sent to the server, which then processes the data to notify external parties of the situation. The output is a notification of the change in emotional state to emergency contacts. This process allows those around the person to understand the situation and provide support as needed.

[0547] (Application Example 2)

[0548] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0549] Ensuring the safety of workers in industrial settings is crucial, but preventing accidents and decreased efficiency caused by worker stress and emotional fluctuations is challenging. This invention aims to provide a system that utilizes workers' biosignals to manage safety and psychological state, enabling rapid response and the provision of an appropriate work environment in emergencies.

[0550] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0551] In this invention, the server includes means for detecting biosignals and storing power, guidance means for acquiring location information and identifying a movement path, emergency communication means for transmitting current location information and health information to an external party in an emergency, emotion detection means for determining the emotional state of a worker in real time, and instruction / notification means for providing instructions and notifying an external party when the emotional state is abnormal. This makes it possible to comprehensively monitor and manage the safety and mental health of workers.

[0552] "Biosignals" refer to data obtained by detecting various physical, chemical, and electrical phenomena generated from the human body.

[0553] "Storing electricity" means preserving energy and making it available for efficient extraction when needed.

[0554] "Location information" refers to data that indicates the geographical location where an object or individual exists.

[0555] "Guidance means" refers to devices or procedures used to guide an object to its destination via a specific route or method.

[0556] "Emergency communication" refers to a means of communication used to quickly and appropriately transmit information to external parties in a critical situation.

[0557] "Emotional state" refers to an individual's mental or psychological state or mood, and includes various elements such as stress, joy, and excitement.

[0558] "Emotion detection" is the process of identifying the type and changes in an individual's emotions from data such as voice, facial expressions, and biometric information.

[0559] A "means of instruction or notification" refers to a method or mechanism for conveying specific information to another entity.

[0560] The system for realizing this invention provides a smart helmet for comprehensively managing the safety and health of employees in industrial settings. The smart helmet can detect the user's biosignals to store power and acquire location information using a GPS module to provide accurate guidance.

[0561] The helmet is equipped with a voice recognition device and biometric data sensors as means of emotion detection, determining the worker's emotional state in real time. This allows it to provide instructions via the helmet's display or voice prompts if stress or anxiety is detected, and to notify remote managers via emergency communication systems in case of abnormalities.

[0562] The specific hardware includes temperature sensors, GPS modules, microphones, and biosensors. The software utilizes a machine learning model based on TensorFlow for real-time emotion detection. Additionally, AWS services are used to send collected data to the cloud, ensuring quick access when needed.

[0563] For example, if a worker notices an unusual noise while operating machinery, an increase in stress can be detected from their tone of voice. In this case, the helmet will display an appropriate alert and, if necessary, warn the manager. This information is stored on a management server and can be used later to devise measures to improve safety.

[0564] Examples of prompts for a generative AI model include the following:

[0565] "Please show how to process voice input to analyze changes in stress levels and suggest recommended safety measures."

[0566] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0567] Step 1:

[0568] When the device is powered on, a temperature sensor constantly monitors the user's body temperature. Using the input biometric data, it detects temperature differences and supplies power to the energy storage device. This allows the device to be used for extended periods.

[0569] Step 2:

[0570] The GPS module in the device continuously acquires the user's location information and determines the current location by referring to a geographic database. Based on this, it calculates a travel route and provides appropriate guidance. Specifically, it instructs the user on the next action via voice or AR display.

[0571] Step 3:

[0572] The device analyzes the user's emotional state in real time using voice recognition and biosensors. It takes voice data, heart rate, and temperature data as input and uses a generative AI model to detect stress and anxiety. If an abnormality is detected, it issues a warning to the user via voice or visual message.

[0573] Step 4:

[0574] If the device detects an abnormal emotional state, it prepares to send the collected data to the server. The data is sent to the server and made accessible to the administrator. The data includes location information, health status, and sentiment analysis results.

[0575] Step 5:

[0576] If a user determines an emergency is occurring and activates emergency communication, the device immediately sends location and health data to the server. The server receives this data and notifies pre-configured emergency contacts. The notification includes the user's situation and recommended actions.

[0577] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0578] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0579] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0580] [Fourth Embodiment]

[0581] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0582] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0583] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0584] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0585] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0586] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0587] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0588] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0589] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0590] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0591] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0592] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0593] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0594] This invention provides a device that functions as a system to support mountain climbers in safely climbing mountains. This device is equipped with a means of sustained power generation using body heat, GPS-based navigation, and emergency communication means. It also has a function to automatically manage the status when entering and descending a mountain and notify the user and related parties of the information.

[0595] Program Processing Description

[0596] The device constantly detects the user's body temperature using sensors, generates power using the temperature difference, and stores it in the battery. This plays a crucial role in preventing the device from running out of battery.

[0597] The device uses GPS to determine the user's location and navigates the hiking route based on surrounding terrain data. While walking, the user receives real-time location information and directional guidance through the device's screen, enabling safe route selection.

[0598] In an emergency, pressing the SOS button on the device immediately sends information about the user's current location and health status to the server. Upon receiving this information, the server automatically notifies registered emergency contacts and arranges for the user to receive the necessary assistance.

[0599] Furthermore, the device automatically recognizes beacons installed at the trailhead and exit point, recording the user's entry and exit from the mountain. The server manages this data and notifies family members and relevant parties of the progress. This allows for real-time monitoring of the user's climbing status.

[0600] As a concrete example, when a user begins climbing a mountain, the device provides an appropriate climbing route and tracks progress in real time. In the event of any health problems, the abnormality detection function activates and immediate action is taken. Upon completion of the climb, the device recognizes the descent beacon, completes the recording, and automatically notifies the user's family of the entire climbing process. In this way, the present invention makes mountain climbing a safer and more secure activity.

[0601] The following describes the processing flow.

[0602] Step 1:

[0603] The device periodically measures the user's skin temperature using a body temperature sensor and detects changes in that temperature. At the same time, it also measures the ambient temperature and calculates the temperature difference.

[0604] Step 2:

[0605] The device performs thermal-electric conversion based on the measured temperature difference, generating power and storing it in the battery. This process enables the device to have a continuous power supply.

[0606] Step 3:

[0607] The device uses a GPS module to periodically obtain its current geographical location and uses that information to display the climber's current location on a map.

[0608] Step 4:

[0609] Users can check their current location and recommended route information through the device's interface and follow a safe hiking route by moving in the indicated direction.

[0610] Step 5:

[0611] The device monitors health and activity levels, such as abnormal heart rate and movement speed, and immediately reports any abnormalities to the server.

[0612] Step 6:

[0613] If a user experiences an emergency, pressing the SOS button on their device will automatically send their location and health data to the server.

[0614] Step 7:

[0615] Based on the emergency information received from the terminal, the server quickly sends notifications to pre-configured emergency contacts and initiates necessary rescue arrangements.

[0616] Step 8:

[0617] During ascent and descent, the device detects beacon signals and automatically updates and records the user's entry or descent status based on those signals.

[0618] Step 9:

[0619] The server stores data on entering and descending the mountain in the cloud and notifies the user's family and registered contacts about the progress, allowing them to keep track of the user's status.

[0620] (Example 1)

[0621] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0622] Mountain climbing in mountainous areas involves harsh natural conditions and carries a high risk of getting lost or injured. Therefore, maintaining power levels, accurately tracking location information, and responding quickly in emergencies are essential for safe climbing. Furthermore, accurately recording the start and end of climbs and coordinating smoothly with external parties are also required, but only a limited number of systems can efficiently handle these tasks.

[0623] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0624] In this invention, the server includes means for detecting the user's body temperature, generating power using the temperature difference, and storing it in a power supply device; navigation means for acquiring location information and guiding the user's route based on topographic information; and emergency communication means for transmitting the user's current location and health information to a central device in an emergency. This enables the maintenance of an appropriate amount of power at all times, optimal route guidance based on location information, and rapid emergency response. Furthermore, by providing management means that automatically record the status at the start and end of a climb and notify the information to a recording medium and relevant parties, the progress of the climb can be accurately grasped, enabling safe climbing.

[0625] "User" refers to an individual who uses this system to climb mountains.

[0626] "Body temperature" refers to the temperature maintained by the human body, and it provides an energy source for generating electricity.

[0627] "Generating electricity" means creating electrical energy by utilizing the temperature difference obtained from a sensor.

[0628] A "power supply unit" is a device for storing and supplying generated electricity.

[0629] "Location information" refers to geographical location data identified using positioning technologies such as GPS.

[0630] "Topographical information" refers to data about the topography and geographical characteristics of a region, and forms the basis for route guidance.

[0631] "Navigation methods" refer to techniques used to guide climbers based on location and topographical information.

[0632] "Emergency communication means" refers to communication methods used to transmit current location and health information to external devices in times of emergency.

[0633] The term "central system" refers to an external management system that receives information via emergency communication means.

[0634] "Recording the status" refers to the act of automatically writing down information about the start and end of a mountain climb.

[0635] A "recording medium" refers to a device or means used to store information.

[0636] "Related parties" refers to individuals or organizations, such as family members or rescue teams, who are involved in ensuring the safety of the user.

[0637] This invention is a system designed to enable mountain climbers to perform their activities safely and efficiently. The system primarily consists of a power generation device that utilizes the user's body heat, a navigation system based on location information, an emergency communication system, and a beacon detection device for automatically recording and managing the system's status.

[0638] The device uses sensors to detect the user's body temperature in real time, generates power from the temperature difference using a Peltier element, and stores that power in the battery. As a result, the device has less to worry about running out of battery and can be used for extended periods.

[0639] The device uses a GPS module to acquire location information and calculates the optimal route based on the acquired coordinate data and terrain data. This navigation function visually displays real-time location information and direction of travel to the user on the screen. This allows the user to choose a safe route.

[0640] In an emergency, the terminal's emergency communication system transmits the user's current location and health status to a central device. Based on this information, the server notifies registered emergency contacts and appropriate rescue organizations to ensure the user receives prompt assistance.

[0641] Furthermore, the device is equipped with a beacon detection function to automatically record the user's status at the start and end of a climb. Beacons are installed at the trailhead and the end of the climb, and the device recognizes the beacon signal and transmits the information to a server. The server uses this data to provide progress information to family members and other relevant parties, allowing for real-time management of the user's climbing status.

[0642] For example, the device is designed to operate stably even in harsh environments and can withstand rapid temperature changes in mountainous areas. Furthermore, it is designed to respond quickly if a user becomes unwell.

[0643] An example of a prompt message would be: "Using a generative AI model, please describe in detail the features of a climber support system based on GPS and body heat generation. Include specific functions and examples to ensure the user can climb safely."

[0644] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0645] Step 1:

[0646] The device continuously measures the user's body temperature using sensors. It receives data on the user's body temperature and ambient temperature as input, generates power through temperature difference calculations using a Peltier element, and stores the resulting power in a battery. This allows the device to provide continuous power for extended periods.

[0647] Step 2:

[0648] The device uses a GPS module to obtain the user's current location. It takes satellite location data as input and analyzes topographic information based on the coordinate data. As a result, it displays an appropriate hiking route and direction on the device's screen. The user is then supported in choosing a safe route based on this information.

[0649] Step 3:

[0650] If a user experiences an emergency, the device uses emergency communication to transmit the user's current location and health information to a server. This data is collected as input and transmitted wirelessly to the server. Based on the received data, the server quickly notifies registered emergency contacts and rescue organizations to arrange for user assistance.

[0651] Step 4:

[0652] The device detects beacons installed at the trailhead and exit point to recognize the start and end of the climb. It receives beacon signals as input, analyzes them to determine the climber's entry and exit status, and sends status data to a server as output, providing progress information to the user's family and related parties. This enables real-time status management, ensuring peace of mind for users.

[0653] (Application Example 1)

[0654] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0655] During mountaineering activities, there is a need to ensure the safety of users while providing a method for external observers to monitor progress in real time. While conventional technologies offer individual functions such as emergency information transmission and continuous power generation using body heat, they lack a comprehensive system that effectively utilizes these functions to facilitate timely information sharing between users and external observers. Therefore, there is a strong desire to further improve the safety of mountaineers and their ability to respond to unforeseen circumstances.

[0656] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0657] In this invention, the server includes means for detecting the user's body temperature, generating electricity using the temperature difference, and storing power; navigation means for acquiring location information and identifying the travel route; communication means for transmitting the user's current location and health information to an external party in an emergency; management means for automatically updating the status when entering and descending a mountain, and recording and notifying the information to an external party; and information distribution means for sharing progress information with external observers in real time. This ensures the safety of users during mountain climbing, and allows external observers to immediately grasp the situation and take necessary actions quickly.

[0658] "A means of detecting body temperature, generating electricity using the temperature difference, and storing electricity" refers to a technology that generates and stores electricity using a power generation system that uses the difference between the user's body temperature and the ambient temperature as a power source.

[0659] A "navigation means for acquiring location information and determining a travel route" is a system that has the function of acquiring the user's current geographical location using a satellite positioning system or the like and determining a travel route.

[0660] "A communication means for transmitting the user's current location and health information to an external party in an emergency" refers to a device that transmits the user's location data and health information to external rescue organizations and related parties via wireless communication or other means in the event of an emergency.

[0661] A "management system that automatically updates status upon entering and descending a mountain and records and notifies information externally" refers to a system equipped with the function of automatically checking and recording the status of entering and descending a mountain when a climb is started and completed, and notifying an external server or relevant parties of that information.

[0662] "Information distribution method for sharing progress information with external observers in real time" refers to a system that transmits the user's current climbing status to relevant parties in real time using communication methods such as the internet.

[0663] The system implementing this invention mainly consists of three elements: a terminal, a server, and a user. The terminal is carried by the user and contains a device that continuously generates electricity using body heat. The terminal also has a GPS module, a temperature sensor, a communication module, and a beacon sensor, which collect and process various data. The generated power is stored, and this power operates the various functions of the terminal.

[0664] The device's detailed processing includes a temperature sensor that constantly monitors body temperature, using the temperature changes to generate power in a power generator and store it in a battery. A GPS module detects the user's current location and transmits this data to navigation software in real time. The navigation software compares this data with terrain data to provide a safe hiking route. In emergencies, a communication module transmits the user's location and health status to a server and notifies registered contacts.

[0665] The server uses the received information to determine whether the user's safety is ensured. It also manages the entry and exit status transmitted from the device and manages a system for notifying family members and relevant parties. Real-time progress information is also aggregated on the server and shared with external observers.

[0666] As a concrete example, when a user begins a climb, the device automatically recognizes the start of the climb, provides a safe route, and sends the user's progress to the server. The user's family can check the progress in real time from home and immediately contact rescue organizations in case of an emergency. This system supports safe mountain climbing activities.

[0667] An example of a prompt message might be: "Please explain in detail how this system manages and notifies emergency information to ensure the safety of climbers."

[0668] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0669] Step 1:

[0670] The device continuously detects the user's body temperature using a temperature sensor. The input is the user's skin temperature, and the sensor records the temperature changes. The temperature difference is converted into electricity by a thermoelectric generator and stored in a battery. This process generates the necessary power and supplies it to the various functions of the device.

[0671] Step 2:

[0672] The device uses a GPS module to obtain the user's location information. The input is a signal received from GPS satellites, which is used to generate the user's latitude and longitude data. Navigation software, integrated with a topographic map, processes this data and displays the optimal hiking route and current progress. The output is navigation instructions.

[0673] Step 3:

[0674] The device's communication module activates when the user presses the SOS button in an emergency. The input is an SOS signal from the user. The user's current location and health status data are sent to a pre-registered server. The server analyzes the received data and automatically notifies emergency contacts. The output is an emergency contact.

[0675] Step 4:

[0676] The device automatically detects beacons at the trailhead or exit point and updates the entry and exit status. The input is a signal from the beacon, which is used to modify the user's status data. The server processes this data and notifies registered family members or others of the progress. The output is an entry or exit status notification.

[0677] Step 5:

[0678] The server aggregates real-time progress information sent from terminals. Inputs include real-time location and route data. This data is processed and distributed so that external observers can view the information via a web portal or mobile app. Output is the distribution of progress information.

[0679] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0680] This invention provides a system that comprehensively supports the safety of mountain climbers, including a body temperature-utilizing charging mechanism, advanced navigation, emergency communication means, and management means, as well as a device equipped with an emotion engine. The emotion engine can analyze the user's emotional state in real time and provide warnings or assistance as needed.

[0681] Program Processing Description

[0682] In this system, the device constantly monitors the user's body temperature, generates power based on the temperature difference, and continuously charges the internal battery. This eliminates concerns about running out of power even during prolonged use.

[0683] The device further uses GPS functionality to obtain the user's precise location, displays their current location based on map data, and guides them along a recommended route. Users can then review this information and continue their climb following a safe route.

[0684] In an emergency, pressing the SOS button on the device instantly sends location and health data to a server, which then quickly notifies emergency contacts. This allows for a rapid response to the emergency.

[0685] The emotion engine analyzes the user's emotions in real time using voice recognition devices and biosensors installed in the device. For example, it determines the stress level from the user's tone of voice and facial expressions, and if necessary, provides relaxing messages via display or voice. If a sudden change in a particular emotion is detected, it notifies an external party of the situation through emergency communication channels.

[0686] As a concrete example, when a user feels anxious during a challenging climb, the emotion engine detects this change in emotion and displays a relaxing message. Simultaneously, if the abnormality persists, a notification is sent to the server, allowing family members in remote locations to be aware of it. In this form, the present invention comprehensively supports the physical and psychological state of climbers.

[0687] The following describes the processing flow.

[0688] Step 1:

[0689] The device continuously measures the user's body temperature using sensors and generates power using the temperature difference. This generated power is stored in the battery, enabling the device to operate continuously.

[0690] Step 2:

[0691] The device uses a GPS module to collect accurate current location information and combines it with map data to provide real-time directions to the user. This allows the user to safely navigate the hiking route.

[0692] Step 3:

[0693] The device uses a built-in emotion engine to analyze the user's voice data and information from biosensors to assess the user's emotional state, such as stress or anxiety.

[0694] Step 4:

[0695] If the emotion engine determines that the user's stress level is high, the device will provide the user with relaxing messages or appropriate action suggestions via voice or screen.

[0696] Step 5:

[0697] If the device determines that the user is in an emergency situation, pressing the SOS button will cause the device to immediately send the latest location information and health-related data to the server.

[0698] Step 6:

[0699] The server receives emergency information sent from the terminal and automatically sends notifications to registered emergency contacts. This information includes the user's current location and emotional state history.

[0700] Step 7:

[0701] The terminal picks up beacon signals installed at the trailhead and exit point and automatically records the user's entry or exit status. This information is recorded and notified to relevant parties via the server.

[0702] Through these steps, the system provides comprehensive support for user safety and offers peace of mind by managing information in real time, including psychological state.

[0703] (Example 2)

[0704] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0705] Ensuring the physical and psychological safety of users is a crucial issue in mountaineering and outdoor activities. Conventional technologies struggle to maintain a continuous power supply, especially during prolonged activities, and to adequately respond to changes in users' emotional states. Furthermore, there is a need for methods to quickly and accurately communicate the situation to the outside in emergency situations.

[0706] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0707] In this invention, the server includes means for detecting the user's body temperature and generating and storing power using the temperature difference; means for acquiring location information and identifying the movement route; and means for analyzing the user's emotional state using voice and biometric data and providing warnings or assistance under predetermined conditions. This comprehensively supports the user's physical and psychological safety, ensures sustained power even during prolonged activity, and enables a rapid response in emergencies.

[0708] "User" refers to a person who uses the system in this invention, and includes those who engage in outdoor activities such as mountain climbing.

[0709] "Body temperature" refers to the temperature of the user's skin surface, and it fluctuates depending on their activity level and environment.

[0710] "Temperature difference" refers to the difference between the user's body temperature and the ambient temperature, and is used for energy conversion.

[0711] "Electricity generation" refers to the process of generating electrical energy by utilizing body temperature and the temperature difference.

[0712] "Means of storing electricity" refers to a function that holds the generated electrical energy and supplies it to other functions of the system.

[0713] "Location information" refers to data indicating the user's geographical location, and is obtained using GPS technology.

[0714] "Travel route" refers to information that shows the path or route that a user should take.

[0715] "Emotional state" refers to the user's current psychological state and feelings, and is analyzed based on voice and biometric data.

[0716] "Warning or assistance" refers to information or instructions provided in accordance with the user's condition, including support to improve the situation.

[0717] The system of the present invention is a comprehensive support device for ensuring the safety of outdoor activity participants, including mountain climbers. This device mainly includes the following components.

[0718] The server receives data from a terminal equipped with a sensor that continuously monitors the user's body temperature. This body temperature data is converted into electricity using a thermoelectric conversion module in the terminal and stored in the device's battery. This ensures that power is maintained even during prolonged use, allowing the user to use the terminal without worrying about the battery running out.

[0719] The device utilizes a high-precision GPS module to acquire the user's location information in real time. This location data is linked with built-in digital map software to display the user's current location and provide guidance on recommended routes. Users can use these navigation functions to safely select a route to their destination and continue their hike.

[0720] When a user presses the designated SOS button on their device, the device quickly sends their current location and health data to a server. This data is automatically sent to pre-registered emergency contacts, ensuring a swift rescue operation.

[0721] A device equipped with emotion analysis capabilities uses a built-in voice recognition module and biosensors to analyze the user's voice and facial expressions to understand their emotional state. If abnormal stress or anxiety is detected, the device will display a message encouraging the user to relax or provide voice guidance. In particular, if a sudden change in emotion is detected, the information is immediately sent to a server, and external notifications will be issued as needed.

[0722] For example, if a user feels anxious on a steep mountain path, the emotion analysis function can detect this state. This allows the device to display a message such as, "You are safe, please relax." Furthermore, notifying family members of the situation enables additional support from outside.

[0723] An example of a prompt for a generative AI model is: "Please suggest a relaxing message to send to a user who feels anxious while hiking. The message should be short and warm."

[0724] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0725] Step 1:

[0726] The device continuously measures the user's body temperature using sensors. The input is the user's skin temperature data, and based on this data, the device calculates the temperature difference between the skin temperature and the ambient temperature. This calculated temperature difference is converted into electricity by a thermoelectric conversion module and stored in the internal battery. This electricity provides the power to continuously operate the device's other functions.

[0727] Step 2:

[0728] The device uses a GPS module to obtain the user's current location information. The input here is a signal from GPS satellites, which the device uses to calculate the user's latitude and longitude. The calculation results are sent to digital mapping software, where they are integrated with map data. This process displays the user's current location and provides recommended directions.

[0729] Step 3:

[0730] When a user presses the SOS button on their device, the device immediately sends the user's current location and health data to the server. The inputs for this step are the user's button press and real-time health data. The server receives this data and takes action to notify pre-registered emergency contacts. The output is a notification of location and health information to the emergency contacts.

[0731] Step 4:

[0732] The device monitors the user's emotional state using a built-in voice recognition module and biosensors. The user's voice tone and facial expression data are used as input and processed by an emotion analysis algorithm. Based on this analysis, if stress or anxiety is detected, the device outputs a message to the user, such as "Try to relax," either by displaying it or playing an audio message.

[0733] Step 5:

[0734] If the emotion analysis detects a sudden change in emotion, the device sends that data to the server. The input for this step is emotion change data, which is sent to the server, which then processes the data to notify external parties of the situation. The output is a notification of the change in emotional state to emergency contacts. This process allows those around the person to understand the situation and provide support as needed.

[0735] (Application Example 2)

[0736] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0737] Ensuring the safety of workers in industrial settings is crucial, but preventing accidents and decreased efficiency caused by worker stress and emotional fluctuations is challenging. This invention aims to provide a system that utilizes workers' biosignals to manage safety and psychological state, enabling rapid response and the provision of an appropriate work environment in emergencies.

[0738] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0739] In this invention, the server includes means for detecting biosignals and storing power, guidance means for acquiring location information and identifying a movement path, emergency communication means for transmitting current location information and health information to an external party in an emergency, emotion detection means for determining the emotional state of a worker in real time, and instruction / notification means for providing instructions and notifying an external party when the emotional state is abnormal. This makes it possible to comprehensively monitor and manage the safety and mental health of workers.

[0740] "Biosignals" refer to data obtained by detecting various physical, chemical, and electrical phenomena generated from the human body.

[0741] "Storing electricity" means preserving energy and making it available for efficient extraction when needed.

[0742] "Location information" refers to data that indicates the geographical location where an object or individual exists.

[0743] "Guidance means" refers to devices or procedures used to guide an object to its destination via a specific route or method.

[0744] "Emergency communication" refers to a means of communication used to quickly and appropriately transmit information to external parties in a critical situation.

[0745] "Emotional state" refers to an individual's mental or psychological state or mood, and includes various elements such as stress, joy, and excitement.

[0746] "Emotion detection" is the process of identifying the type and changes in an individual's emotions from data such as voice, facial expressions, and biometric information.

[0747] A "means of instruction or notification" refers to a method or mechanism for conveying specific information to another entity.

[0748] The system for realizing this invention provides a smart helmet for comprehensively managing the safety and health of employees in industrial settings. The smart helmet can detect the user's biosignals to store power and acquire location information using a GPS module to provide accurate guidance.

[0749] The helmet is equipped with a voice recognition device and biometric data sensors as means of emotion detection, determining the worker's emotional state in real time. This allows it to provide instructions via the helmet's display or voice prompts if stress or anxiety is detected, and to notify remote managers via emergency communication systems in case of abnormalities.

[0750] The specific hardware includes temperature sensors, GPS modules, microphones, and biosensors. The software utilizes a machine learning model based on TensorFlow for real-time emotion detection. Additionally, AWS services are used to send collected data to the cloud, ensuring quick access when needed.

[0751] For example, if a worker notices an unusual noise while operating machinery, an increase in stress can be detected from their tone of voice. In this case, the helmet will display an appropriate alert and, if necessary, warn the manager. This information is stored on a management server and can be used later to devise measures to improve safety.

[0752] Examples of prompts for a generative AI model include the following:

[0753] "Please show how to process voice input to analyze changes in stress levels and suggest recommended safety measures."

[0754] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0755] Step 1:

[0756] When the device is powered on, a temperature sensor constantly monitors the user's body temperature. Using the input biometric data, it detects temperature differences and supplies power to the energy storage device. This allows the device to be used for extended periods.

[0757] Step 2:

[0758] The GPS module in the device continuously acquires the user's location information and determines the current location by referring to a geographic database. Based on this, it calculates a travel route and provides appropriate guidance. Specifically, it instructs the user on the next action via voice or AR display.

[0759] Step 3:

[0760] The device analyzes the user's emotional state in real time using voice recognition and biosensors. It takes voice data, heart rate, and temperature data as input and uses a generative AI model to detect stress and anxiety. If an abnormality is detected, it issues a warning to the user via voice or visual message.

[0761] Step 4:

[0762] If the device detects an abnormal emotional state, it prepares to send the collected data to the server. The data is sent to the server and made accessible to the administrator. The data includes location information, health status, and sentiment analysis results.

[0763] Step 5:

[0764] If a user determines an emergency is occurring and activates emergency communication, the device immediately sends location and health data to the server. The server receives this data and notifies pre-configured emergency contacts. The notification includes the user's situation and recommended actions.

[0765] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0766] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0767] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0768] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0769] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. In the upper and lower directions of the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. Also, the upper side of the concentric circles is where "pleasant" emotions are located, and the lower side is where "unpleasant" emotions are located. In this way, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0770] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0771] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0772] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0773] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0774] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0775] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0776] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0777] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0778] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0779] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0780] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0781] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0782] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0783] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0784] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0785] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0786] The following is further disclosed regarding the embodiments described above.

[0787] (Claim 1)

[0788] A means of detecting the user's body temperature, generating electricity using the temperature difference, and storing that electricity,

[0789] A navigation means that acquires location information and determines the travel route,

[0790] An emergency communication means that transmits the user's current location and health information to an external party in an emergency,

[0791] A management system that automatically updates the status upon entering and descending the mountain, and records and notifies information externally,

[0792] A safety support system including this.

[0793] (Claim 2)

[0794] The safety support system according to claim 1, wherein the emergency communication means is activated based on the user's press of an emergency button.

[0795] (Claim 3)

[0796] The safety support system according to claim 1, wherein the management means updates the entry and exit status based on the detection of surrounding signaling devices.

[0797] "Example 1"

[0798] (Claim 1)

[0799] A means for detecting the user's body temperature, generating electricity using the temperature difference, and storing it in a power supply device,

[0800] Navigation means that acquires location information and guides the course based on topographic information,

[0801] An emergency communication system that transmits the user's current location and health information to a central device in an emergency,

[0802] A management system that automatically records the status at the start and end of a climb and notifies the information to external recording media and relevant parties,

[0803] A safety monitoring system that issues warnings to users and provides essential notifications when an anomaly is detected,

[0804] A system that includes this.

[0805] (Claim 2)

[0806] The system according to claim 1, wherein the emergency communication means is activated based on an emergency operation by the user.

[0807] (Claim 3)

[0808] The system according to claim 1, wherein the management means updates the start and end status of the climb based on the detection of surrounding identification devices.

[0809] "Application Example 1"

[0810] (Claim 1)

[0811] A means of detecting the user's body temperature, generating electricity using the temperature difference, and storing that electricity,

[0812] A navigation means that acquires location information and determines the travel route,

[0813] A communication means for transmitting the user's current location and health information to an external party in an emergency,

[0814] A management system that automatically updates the status upon entering and descending the mountain, and records and notifies information externally,

[0815] A means of distributing information to share progress information with external observers in real time,

[0816] A system that includes this.

[0817] (Claim 2)

[0818] The system according to claim 1, wherein the communication means is activated based on an emergency operation by the user.

[0819] (Claim 3)

[0820] The system according to claim 1, wherein the management means updates the entry and exit status based on the detection of surrounding signaling devices.

[0821] "Example 2 of combining an emotion engine"

[0822] (Claim 1)

[0823] A means of detecting the user's body temperature, generating electricity using the temperature difference, and storing that electricity,

[0824] A navigation means that acquires location information and determines the travel route,

[0825] An emergency communication means that transmits the user's current location and health information to an external party in an emergency,

[0826] An emotion analysis means that analyzes the user's emotional state using voice and biometric data and provides warnings or assistance under predetermined conditions,

[0827] A means of notifying the outside world of the situation when an emotional change is detected,

[0828] ...

[0829] A system that includes this.

[0830] (Claim 2)

[0831] The system according to claim 1, wherein the emergency communication means is activated based on the user's pressing of an emergency button.

[0832] (Claim 3)

[0833] The system according to claim 1, wherein the management means updates the entry and exit status based on the detection of surrounding signaling devices.

[0834] "Application example 2 when combining with an emotional engine"

[0835] (Claim 1)

[0836] A means of detecting the user's biosignals and using their fluctuations to store electricity,

[0837] A guidance means that acquires location information of the object to be moved and determines the movement path,

[0838] An emergency communication method that transmits the user's current address and health-related information to an external party in an emergency,

[0839] A management system that automatically updates the status at the start and end of movement, and records and notifies information externally,

[0840] An emotion detection means that determines the emotional state of a worker in real time,

[0841] Instruction and notification means for providing instructions to workers and notifying external parties when an emotional state is abnormal.

[0842] A system that includes this.

[0843] (Claim 2)

[0844] The system according to claim 1, wherein the emergency communication means is operated based on user operation.

[0845] (Claim 3)

[0846] The system according to claim 1, wherein the management means updates the start and end states of movement based on the detection of surrounding signaling equipment. [Explanation of Symbols]

[0847] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of detecting the user's body temperature, generating electricity using the temperature difference, and storing that electricity, A navigation means that acquires location information and determines the travel route, An emergency communication means that transmits the user's current location and health information to an external party in an emergency, A management system that automatically updates the status upon entering and descending the mountain, and records and notifies information externally, A safety support system including this.

2. The safety support system according to claim 1, wherein the emergency communication means is activated based on the user's operation of an emergency button.

3. The safety support system according to claim 1, wherein the management means updates the entry and exit status based on the detection of surrounding signal devices.

Images