System

Abstract

A system is provided.SOLUTION: A system comprising: means for providing appropriate mountaineering route information based on a user's experience level; means for obtaining the user's current location and tracking progress in real-time; and means for sharing the user's mountaineering location information to designated contacts in real-time.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Mountain climbing has become popular in recent years, but the number of accidents has also increased. Beginners and inexperienced climbers in particular have difficulty choosing the right route, and this is due to insufficient equipment and rest stops. Furthermore, since users' current location and progress cannot be tracked in real time during a climb, it is difficult to respond quickly in the event of an accident. Therefore, there is a need for a system that can ensure the safety of climbers and provide appropriate mountaineering guidance and emergency response. [Means for solving the problem]

[0005] The present invention is a system that includes a means for providing appropriate mountain climbing route information based on the user's experience level, a means for acquiring the user's current location and tracking progress in real time, and a means for sharing the user's mountain climbing location information with designated contacts in real time. Furthermore, by including a means for managing the user's behavior and measuring the course time, and a means for periodically transmitting the user's location information and progress to a server and enabling emergency response as needed, the system can improve the safety of mountain climbers. As a result, mountain climbers can enjoy mountain climbing with peace of mind, and a quick response can be provided in the event of an accident.

[0006] "User" refers to an individual who uses the mountain climbing system, and is the person who receives route information and location information tracking by the system.

[0007] "Experience level" is an index that indicates the degree of mountain climbing experience of the user, and is classified into a range from beginner to advanced.

[0008] "Mountain climbing route information" refers to detailed information about the mountain climbing course selected by the user, including route maps, necessary items to bring, rest points, and information on tent sites and mountain huts.

[0009] "Current Location" refers to the real-time location of a user obtained using GPS or other location measurement technology.

[0010] "Progress" is information that indicates the progress of the user based on the user's current location while climbing a mountain, and includes the difference between the planned course time and the actual time.

[0011] "Designated contacts" refers to contact information for family members or acquaintances that the user has set up for emergencies or for sharing location information.

[0012] "Real-time sharing" means providing instant updates of a user's location and progress to designated contacts.

[0013] "Behavior management" refers to monitoring the user's movements and itinerary while climbing, and providing appropriate support and time management.

[0014] "Course time" refers to the estimated time it takes to reach a specific point on a climbing route, and is the basis for evaluating progress.

[0015] "Emergency response" refers to measures to respond quickly when a user faces an accident or problem, including location sharing and notification methods. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone devices. Specific program processing of this system is described below.

[0038] 1. User registration and initial settings

[0039] Users install the app and enter their personal information and climbing experience level, which is then used to suggest suitable climbing routes and respond in emergencies.

[0040] 2. Route selection and information provision

[0041] The user selects a climbing route suitable for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.).

[0042] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[0043] 3. Start of climbing and measuring course time

[0044] On the day of the climb, when the user presses the "Start Climbing" button on the app, the smartphone activates the GPS and tracks the user's current location in real time. The device then sends the user's progress to the server and measures the course time.

[0045] Example: When a user presses the "Start climbing" button at the start of a mountain climb, the smartphone device acquires location information and determines the user's current location in real time. It also calculates the difference between the planned course time and actual progress, and notifies the user of delays and progress.

[0046] 4. Sharing progress and emergency response

[0047] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0048] Example: The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[0049] This allows climbers to enjoy climbing with peace of mind and enables immediate response in the event of an emergency. Furthermore, by providing information on each step and tracking their location in real time, the system provides a safer climbing experience. This system is especially beneficial for beginners and inexperienced climbers, encouraging them to climb without straining themselves.

[0050] The processing flow will be explained below.

[0051] Step 1:

[0052] A user installs the app and creates an account. The user enters personal information (such as name, contact details, and experience level) and sets up the account.

[0053] Step 2:

[0054] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[0055] Step 3:

[0056] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[0057] Step 4:

[0058] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[0059] Step 5:

[0060] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[0061] Step 6:

[0062] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[0063] Step 7:

[0064] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[0065] Step 8:

[0066] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[0067] Step 9:

[0068] The smartphone device measures the user's course time, evaluates their progress, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[0069] Step 10:

[0070] In the unlikely event of an accident, the server will automatically send the user's location information and emergency alert to emergency contacts, enabling a rapid response.

[0071] In this way, through the processing of each step, climbers can enjoy climbing safely and a system is provided that allows for quick response in the event of an emergency.

[0072] Example 1

[0073] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0074] Current mountain climbing support systems have difficulty selecting the optimal route based on the user's climbing experience and skills, and do not adequately track the user's location and share their progress in real time during the climb, which can delay emergency response.In addition, there is no appropriate notification system in place that reflects the user's progress, making it difficult to fully ensure the safety of climbers.

[0075] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0076] In this invention, the server includes means for inputting and saving the user's personal information and climbing experience level, and selecting and providing a route based on that information; means for acquiring the user's current location and tracking progress in real time; means for sharing the user's climbing location information with designated contacts in real time; and means for calculating the difference between the planned course time and actual progress based on the user's progress and notifying the user of the difference. This allows the server to provide the optimal climbing route based on the user's experience, and real-time location tracking and progress sharing enable rapid response in emergencies. Furthermore, appropriate notifications based on progress can increase the safety of climbers.

[0077] "User" refers to an individual who uses the mountain climbing support system.

[0078] "Experience level" refers to a standard for classifying a user's mountaineering experience and skill level.

[0079] "Mountain climbing route information" refers to the route and related information when a user goes mountain climbing (route map, list of items to bring, rest points, information on tent sites and mountain huts, etc.).

[0080] "Current location" refers to geographical information that indicates where the user is in real time while climbing a mountain.

[0081] "Progress" refers to the state that indicates how much progress the user has made while climbing.

[0082] "Real-time" refers to the fact that the user's current location and progress are known immediately and without delay.

[0083] "Designated Contact" refers to a person or organization registered with whom you share your location information in case of an emergency, etc.

[0084] "Personal information" refers to information that identifies an individual user, such as the user's name and contact information.

[0085] "Server" refers to a computer system that processes and stores data from users and provides necessary information.

[0086] "GPS" stands for Global Positioning System, a satellite navigation system for determining location on Earth.

[0087] "Discrepancy" refers to the difference in time or distance between the scheduled course time and the user's actual progress.

[0088] "Notification" refers to a message or alert that the system uses to immediately inform the user of important information.

[0089] "Course time" refers to the estimated time that indicates how long it will take the user to complete each section of the mountain climb.

[0090] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone terminals. Specific program processing of this system is described below.

[0091] User registration and initial settings

[0092] Users install a mountaineering support app on their smartphone and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond in emergencies. The device sends this data to a server, which stores it in a database.

[0093] Specific examples

[0094] The user installs the app and enters their name, phone number, and the fact that they are a beginner climber. The device sends this information to the server, which then stores it.

[0095] Route selection and information provision

[0096] The user selects a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app. Based on this selection, the server sends the necessary route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) to the device.

[0097] Specific examples

[0098] When a beginner user selects a "Level 1" route in the app, the server displays a detailed map from the entry point to the finish line, a list of items to bring, and appropriate rest stops on the device.

[0099] Start of climbing and course time measurement

[0100] When the user starts climbing, they press the "Start Climbing" button on the app. This activates the device's GPS and tracks the user's current location in real time. The device periodically sends the user's progress to the server, which uses this information to measure the course time. The device also notifies the user if their progress is slow or too fast.

[0101] Specific examples

[0102] When the user presses the "Start Climbing" button to begin climbing, the device acquires location information and grasps the user's location in real time. It calculates the difference between the planned course time and the actual progress and sends a notification of this to the device.

[0103] Sharing progress and responding to emergencies

[0104] The server periodically shares the user's location information with emergency contacts, enabling a rapid response in the unlikely event of an accident. Emergency contacts can check the user's location and progress in real time via a webpage or dedicated app. If the user significantly exceeds the scheduled course time, an automatic alert is sent, urging a rapid response.

[0105] Specific examples

[0106] The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[0107] Prompt Sentence Examples

[0108] Examples of prompts to input to a generative AI model include:

[0109] "Please explain how a system that provides a safe mountain climbing experience for beginner climbers works. The system begins by the user registering their personal information and climbing experience level on their smartphone and selecting an appropriate climbing route. Once the climb begins, the system uses GPS to track the user's location in real time, sending their progress to a server and sharing their location with emergency contacts. It is designed to ensure a rapid response in the event of an emergency."

[0110] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0111] Step 1:

[0112] The user installs a mountain climbing support app on their smartphone and enters their personal information and mountain climbing experience level.

[0113] Input: User's name, contact information, and climbing experience level.

[0114] Data processing and output: The terminal processes the input data and sends it to the server, which receives it and stores it in a database.

[0115] Specific actions

[0116] 1. A user downloads an app from the App Store or GOOGLE PLAY(R).

[0117] 2. The user launches the app and enters their name, contact information, and climbing experience.

[0118] 3. The device sends this data to the server, which receives it and stores it in a database.

[0119] Step 2:

[0120] Users select a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app.

[0121] Input: The user's climbing experience level.

[0122] Data processing and output: The server selects an appropriate climbing route based on the user's experience level, generates route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.), and sends it to the device.

[0123] Specific actions

[0124] 1. The user opens the "Route Selection" menu.

[0125] 2. The user selects a route appropriate for their experience level, e.g. "Level 1".

[0126] 3. The server generates route information based on the selected route and sends it to the terminal.

[0127] 4. The device displays the route information to the user.

[0128] Step 3:

[0129] When the user starts climbing, they press the "Start Climbing" button on the app.

[0130] Input: Press the Start Climbing button.

[0131] Data processing and output: The device activates the GPS, acquires the user's current location, and sends it to the server. The server receives this information and starts measuring the course time.

[0132] Specific actions

[0133] 1. The user presses the "Start climbing" button in the app.

[0134] 2. The device activates the GPS and acquires location information.

[0135] 3. The device periodically sends location information to the server.

[0136] 4. The server receives the location information and measures the course time.

[0137] Step 4:

[0138] The server checks the user's progress and calculates the difference between the planned course time and the actual progress.

[0139] Input: User's real-time location data.

[0140] Data processing and output: The server compares the time with the planned course time, calculates the discrepancy, and notifies the terminal of the result.

[0141] Specific actions

[0142] 1. The server receives location information sent at regular intervals.

[0143] 2. The server calculates the difference between the scheduled course time and the actual progress.

[0144] 3. The server notifies the device of the deviation result.

[0145] Step 5:

[0146] The server periodically shares the user's location information with emergency contacts.

[0147] Input: User's location, emergency contact information.

[0148] Data processing and output: The server sends location information to emergency contacts and generates alerts as needed.

[0149] Specific actions

[0150] 1. The server periodically updates the user's location.

[0151] 2. The server sends the location information to the emergency contact.

[0152] 3. The emergency contact user checks the user's location through a dedicated web page or app.

[0153] 4. The server automatically sends an alert if the user significantly exceeds the scheduled course time.

[0154] (Application example 1)

[0155] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0156] In today's mountaineering environment, ensuring climber safety and responding quickly in emergencies are essential, but there are limited systems that can effectively achieve this. Furthermore, there is a lack of appropriate route suggestions and progress management for beginners and inexperienced climbers, increasing the risk of accidents during mountaineering. To solve these problems, a system with real-time location tracking and automatic notification to emergency contacts is needed.

[0157] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0158] In this invention, the server includes a means for providing appropriate mountain climbing route information based on the user's experience level, a means for acquiring the user's current location and tracking the user's progress in real time, a means for sharing the user's mountain climbing location information with designated contacts in real time, and a means for automatically issuing alerts in the event of an emergency. This ensures the safety of the climber, enables rapid emergency response, and enables a natural mountain climbing activity through route suggestions.

[0159] A "user" is an individual climber who uses the system, inputs the necessary information, and enjoys a safe climbing experience.

[0160] "Mountain climbing route information" refers to information such as guidelines, a list of items to bring, and rest points necessary for mountain climbing, which are provided based on the user's experience level and selection.

[0161] "Current location" refers to the climber's real-time geographic location, obtained using technology such as GPS.

[0162] "Progress" refers to information such as where a climber is along the climbing route, the difference between planned and actual progress, and so on.

[0163] "Designated Contacts" are the climber's registered emergency contacts, which may include family, friends, or rescue agencies.

[0164] "Means for automatically sending alerts in emergencies" is a function that automatically sends a warning to registered emergency contacts when a situation that threatens the safety of climbers is detected.

[0165] "Behavior management" is the process of tracking a user's progress and behavior and ensuring adherence to planned schedules and routes.

[0166] "Course time" refers to the estimated or actual time required to reach the destination from the starting point of a climb.

[0167] A "server" is a central processing unit that provides information, tracks locations, manages progress, etc. based on requests from users.

[0168] To implement the present invention, a system program is required that performs the following steps in order.

[0169] Program processing overview

[0170] User registration and initial settings

[0171] After installing the smartphone app, users input their personal information and climbing experience level, which is then sent to the server, where appropriate initial settings are made.

[0172] Route selection and information provision

[0173] The server provides climbing route information based on the user's experience level. Specifically, the server selects an appropriate route from a pre-prepared route database and sends it to the user's smartphone along with a list of items to bring, information on rest points, tent sites, and mountain huts.

[0174] Start climbing and track location

[0175] When a user presses the "Start Climbing" button, the smartphone's GPS function is activated and the current location is sent to the server in real time. The server analyzes the progress and shares the user's location information with designated contacts.

[0176] Emergency response

[0177] The server periodically manages the user's progress and location information, and has a means to automatically send alerts in the event of an emergency, so that designated contacts are promptly notified of the emergency situation.

[0178] Hardware and software used

[0179] Hardware

[0180] Smartphone: Equipped with a built-in GPS module for acquiring location information (e.g., iPhone (registered trademark), ANDROID (registered trademark) devices).

[0181] Smart glasses: Provide visual information needed while climbing (e.g., Google® Glass®).

[0182] Head-mounted displays: display real-time maps and route information (e.g., HoloLens®).

[0183] software

[0184] Server: A central management system that provides information, location tracking, and emergency notifications (e.g., AWS (registered trademark), Google Cloud Platform).

[0185] Mobile app development platforms: Used for application development (e.g., React Native, Flutter (registered trademark)).

[0186] Notification system: Provides periodic updates and alerts (e.g., Firebase Cloud Messaging).

[0187] Examples

[0188] For example, when a beginner climber climbs a mountain for the first time, they use the app to select a route and begin climbing based on the route information provided by the server. As they climb, their smartphone tracks the user's location in real time and periodically sends the location information to the server. The server analyzes this information and notifies the user's family of their progress in real time. In the unlikely event of an accident or overrun, an emergency alert is automatically sent to the family's smartphone.

[0189] Prompt Sentence Examples

[0190] "The following application will have real-time tracking and emergency alert functions to ensure the safety of climbers. Specific functions include user registration, climbing route selection, GPS tracking, and real-time location sharing. Please provide the program code to implement this."

[0191] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0192] Step 1:

[0193] A user installs the app on their smartphone and enters their personal information and climbing experience level. This information is sent from the device to the server. The input data includes the user's name, contact information, and past climbing experience (beginner, intermediate, advanced). The server receives this data and generates a user profile.

[0194] Step 2:

[0195] The user selects a mountain climbing route suitable for their experience level from the "Route Selection" menu within the app. The server generates appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) based on the selected experience level. The user's experience level and selected route are provided to the server as input, and the server retrieves the relevant route information from its internal database and sends it to the device.

[0196] Step 3:

[0197] When a user presses the "Start Mountain Climbing" button on their smartphone, the device activates its GPS function and acquires their current location. GPS data (latitude, longitude, altitude, etc.) is sent to the server in real time. The server receives input data, including location information from the GPS, and tracks the user's progress.

[0198] Step 4:

[0199] The server analyzes the user's progress based on the received current location data. The server compares the user's progress against the scheduled course time and evaluates progress and delays. Input data includes GPS location information and the pre-set course time, and output data includes progress and delays sent to the device.

[0200] Step 5:

[0201] The server periodically sends the user's progress and location to a designated emergency contact. Input data includes the current location and progress, and output includes notifications to the emergency contact. The server uses a notification system such as Firebase Cloud Messaging to notify the designated contact of the progress.

[0202] Step 6:

[0203] If a user significantly exceeds the scheduled course time, the server will automatically send an emergency alert. Input data includes the user's current location and calculated progress, and output includes an emergency notification to emergency contacts. This allows registered emergency contacts to be alerted immediately and promptly respond.

[0204] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0205] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. Specific program processing of this system is described below.

[0206] 1. User registration and initial settings

[0207] Users install the app and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond to emergencies. Users can also set emergency contacts (family or acquaintances) to ensure quick contact in case of emergency.

[0208] 2. Route selection and information provision

[0209] The user selects a mountain climbing route appropriate for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides the user's app with appropriate route information (route map, necessary items, rest points, information on tent sites and mountain huts, etc.).

[0210] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[0211] 3. Start of climbing and measuring course time

[0212] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts recording the climb and enables the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[0213] 4. Sharing progress and emergency response

[0214] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0215] 5. Incorporating an Emotional Engine

[0216] The emotion engine is installed in the smartphone and recognizes the user's emotions. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[0217] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[0218] 6. Emotion data contact sharing

[0219] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[0220] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[0221] 7. Comprehensive Safety Assessment and Emergency Measures

[0222] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[0223] Example: If the server determines, based on the user's emotional and progress data, that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[0224] In this way, by incorporating an emotion engine, climbers' safety can be managed more meticulously, allowing them to enjoy mountain climbing with peace of mind. Furthermore, we have built a system that can respond quickly in the unlikely event of an emergency.

[0225] The processing flow will be explained below.

[0226] Step 1:

[0227] A user installs the app, creates an account, and enters personal information (such as name, contact details, and experience level) to set up the account.

[0228] Step 2:

[0229] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[0230] Step 3:

[0231] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[0232] Step 4:

[0233] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[0234] Step 5:

[0235] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[0236] Step 6:

[0237] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[0238] Step 7:

[0239] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[0240] Step 8:

[0241] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[0242] Step 9:

[0243] The smartphone device manages the user's actions, measures the course time, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[0244] Step 10:

[0245] The emotion engine installed in the smartphone recognizes the user's emotions and analyzes data such as the user's facial expressions, voice, and heart rate to determine the user's current emotional state.

[0246] Step 11:

[0247] The smartphone device transmits the emotional state recognized by the emotion engine to the server, which allows the server to grasp the user's emotional state.

[0248] Step 12:

[0249] The server shares the emotional information recognized by the emotion engine with designated contacts in real time, allowing emergency contacts to check the user's emotional state.

[0250] Step 13:

[0251] The server integrates the emotional data and location information to make a comprehensive safety assessment, and takes emergency measures if it determines that the user is in danger.

[0252] Step 14:

[0253] In the event of an accident or if the user is in an extremely unstable emotional state, the server automatically sends a notification to emergency contacts and prepares to dispatch a rescue team if necessary.

[0254] In this way, by incorporating an emotion engine, the system can grasp the emotional state of climbers in real time, provide appropriate support and emergency measures, and provide a safer climbing experience.

[0255] Example 2

[0256] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0257] To effectively manage the safety of climbers, it is important to provide appropriate route information according to their experience level and to grasp their location information in real time. Furthermore, to respond quickly to emergencies, it is necessary to share the user's location and progress with relevant parties. Furthermore, it is also necessary to continuously monitor the user's emotional state while climbing and detect abnormalities early. However, there has been no previous system that provides comprehensive support and manages all of these in a unified manner.

[0258] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for providing appropriate route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's location information and emotional information with designated contacts in real time, means for using an emotion engine to analyze the user's emotional state, and means for performing a comprehensive safety assessment based on the user's location information and emotional information and taking emergency measures. This enables advanced management of climber safety and rapid response in emergencies.

[0259] A "user" is an individual who uses this system to go mountain climbing.

[0260] "Experience level" is an index that indicates the user's mountain climbing experience, and includes levels such as beginner, intermediate, and advanced.

[0261] "Route information" refers to detailed information about mountain climbing routes, including route maps, necessary items to bring, rest points, and information on tent sites and mountain huts.

[0262] "Current location" is location information of the location where the user is currently located, and is obtained using GPS.

[0263] "Progress status" refers to a state that includes information such as where the user is on the mountain climbing route and progress over time.

[0264] "Real-time" refers to the fact that data is sent and received almost instantaneously, meaning that the latest information is updated without delay.

[0265] "Contacts" refers to information about individuals or organizations that a user has registered to be contacted in an emergency.

[0266] An "emotion engine" is software or hardware that analyzes a user's emotional state, using data such as facial expressions, voice, and heart rate.

[0267] "Emotion information" is data that indicates the user's current emotional state as a result of analysis by the emotion engine.

[0268] "Safety assessment" is a process of assessing the safety of a user while climbing a mountain based on the user's location information and emotional information.

[0269] "Emergency measures" are measures that are taken immediately when it is determined that the user is in danger, and include notifying contacts and dispatching a rescue team.

[0270] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. A specific embodiment of this system will be described below.

[0271] User registration and initial settings

[0272] First, users install the app on their smartphone. After launching the app, they enter their personal information and climbing experience level. This information is later used to suggest suitable climbing routes and respond to emergencies. Users also set up emergency contacts (family or acquaintances) so they can be contacted immediately if necessary.

[0273] Route selection and information provision

[0274] When a user opens the "Route Selection" menu in the app, the server filters suitable climbing routes based on the user's experience level and current location. When the user selects one of the suggested routes, the server provides detailed information about that route (route map, necessary items, rest points, information on tent sites and mountain huts, etc.) to the user's smartphone.

[0275] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1," including a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest stops.

[0276] Start of climbing and course time measurement

[0277] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts the climb recording and activates the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[0278] Sharing progress and responding to emergencies

[0279] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0280] Incorporating an emotion engine

[0281] The emotion engine is installed in the smartphone and recognizes the user's emotional state. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[0282] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[0283] Emotion data contact sharing

[0284] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[0285] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[0286] Comprehensive safety assessment and emergency measures

[0287] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[0288] Example: If the server determines based on the user's emotional and progress data that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[0289] Example prompt

[0290] The prompt sentences to input to the generative AI model are shown below.

[0291] Please explain the program processing for the following system in natural language. Please write so that the subject is either the server, the terminal, or the user. Please write sentence endings in the plain style.

[0292] (System) The system of this invention provides climbers with a safe and effective mountain climbing experience through collaboration between users, servers, smartphone devices, and an emotion engine.

[0293] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0294] Step 1: User registration and initial setup

[0295] The user installs the app on their smartphone. After installation is complete, the user launches the app and enters personal information such as name, age, gender, and emergency contact information, as well as their climbing experience level. This information is sent to a server and used to suggest appropriate climbing routes and respond in emergencies.

[0296] Input: Personal information (name, age, gender, emergency contact information), climbing experience level

[0297] Output: User information stored on the server

[0298] Specific operation: When the user enters information and presses the submit button, the server saves the information in a database.

[0299] Step 2: Route selection and information provision

[0300] The user opens the "Route Selection" menu in the app and selects a climbing route. The server filters and suggests suitable climbing routes based on the user's experience level and current location. Once the user selects a route, the server generates detailed route information and sends it to the smartphone device.

[0301] Input: current location, experience level

[0302] Output: Appropriate hiking route information (route map, packing list, rest points, etc.)

[0303] Specific operation: The server extracts the appropriate route from the database, generates detailed information and sends it to the user.

[0304] Step 3: Start climbing and measure course time

[0305] On the day of the climb, the user presses the "Start Climbing" button on the app. The smartphone activates GPS and acquires the user's current location in real time. The acquired location information is sent to a server and used to track progress.

[0306] Input: GPS data (current location)

[0307] Output: Real-time location data

[0308] Specific operation: The smartphone device periodically measures its current location and sends that data to the server.

[0309] Step 4: Sharing progress and emergency response

[0310] The server periodically acquires the user's location information and shares it with emergency contacts in real time. If an abnormality is detected in the user's progress, an alert will be sent to the emergency contacts.

[0311] Input: User's location

[0312] Output: Location sharing data to emergency contacts, alerts

[0313] Specific operation: The server analyzes the location information and notifies emergency contacts if there is an abnormality.

[0314] Step 5: Incorporating the Emotion Engine

[0315] The smartphone device is equipped with an emotion engine that analyzes the user's emotional state based on facial expressions, voice, heart rate, etc. The emotion engine sends the results to a server, which uses them for safety management.

[0316] Input: facial expression data, voice data, heart rate data

[0317] Output: Emotional state data

[0318] Specific operation: The smartphone device's sensors collect data, the emotion engine analyzes it, and sends the results to the server.

[0319] Step 6: Share emotion data with contacts

[0320] The server shares the user's emotional information recognized by the emotion engine with emergency contacts in real time. Designated family members and acquaintances can check the user's emotional state and take prompt action if necessary.

[0321] Input: Emotional state data

[0322] Output: Shared emotional state information

[0323] Specific operation: The server extracts the emotion data and sends it to the emergency contact.

[0324] Step 7: Comprehensive safety assessment and emergency measures

[0325] The server integrates the user's location and emotional data to provide a comprehensive safety assessment. If the server determines that the user is in danger, it immediately takes emergency measures, contacting emergency contacts and dispatching rescue teams if necessary.

[0326] Input: location data, emotional state data

[0327] Output: Safety assessment results, emergency measures

[0328] Specific operation: The server analyzes the data and immediately initiates emergency response procedures if a danger is detected.

[0329] Through the above steps, the system of the present invention can manage the safety of climbers in a sophisticated manner and can respond quickly in the event of an emergency.

[0330] (Application example 2)

[0331] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0332] Conventional systems lack the ability to appropriately recognize the emotional state of factory workers and dynamically adjust robot work instructions based on that state. As a result, when workers feel stressed or fatigued, not only does it become difficult to work efficiently, but safety also decreases. The present invention aims to solve these problems by providing a system that recognizes the emotional state of workers and adjusts work based on that state.

[0333] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0334] In this invention, the server includes means for providing appropriate work route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's work location information with designated contacts in real time, emotion processing means for recognizing and analyzing the user's emotional state, and control means for changing work instructions according to the emotional state, thereby enabling dynamic work adjustments in line with the worker's emotional state, improving safety and efficiency.

[0335] The "user experience level" is an index that indicates the worker's past work experience and skill level.

[0336] "Work route information" is information about a series of procedures and routes for workers to carry out work efficiently and safely.

[0337] "Current location" is information that indicates the exact location where the worker is currently located within the factory.

[0338] "Progress" is information that indicates the state and progress of the work process that the worker is currently in progress.

[0339] "Work location information" is information about the location where a worker is working within a factory.

[0340] "Designated Contacts" are people or departments designated to receive notification in the event of an emergency or other need.

[0341] "Emotional state" refers to the worker's current psychological state, and includes stress, fatigue, joy, etc.

[0342] "Emotion processing means" refers to techniques and methods for analyzing data such as a worker's facial expression, voice, and heart rate to recognize their emotional state.

[0343] "Control means" refers to techniques and methods for dynamically adjusting work instructions and robot behavior based on the acquired emotional state.

[0344] The system for realizing this invention mainly consists of three elements: a server, a terminal, and a user. Specifically, it provides appropriate work route information based on the user's experience level, acquires the user's current location, and tracks the user's progress in real time. It also includes a control system that recognizes the user's emotional state and dynamically changes work instructions based on that state.

[0345] Explanation of program processing

[0346] Hardware and Software Use

[0347] The hardware of the entire system includes a smartphone and head-mounted display (HMD) worn by the user, communication modules (Wi-Fi, Bluetooth, etc.) placed in the work environment, and sensors for measuring emotions (heart rate monitor, microphone, camera).The factory robot is managed using ROS (Robot Operating System).

[0348] Data processing and calculation

[0349] The server generates appropriate work route information based on the user's experience level and sends it to the device. The user's progress is captured in real time using GPS and internal sensors, and the results are periodically sent to the server. The server also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, etc. to identify and record their emotional state. Based on the emotional state, the server sends appropriate instructions to the factory robot and dynamically adjusts the robot's operation.

[0350] Use case details

[0351] Specific use cases include the following: If the emotion engine recognizes a user's stress level from their facial expressions or voice, the server immediately acquires the data and adjusts the working robot's movement speed to a slower speed. Also, if the user's heart rate is abnormally high, the server sends an instruction to the robot to temporarily halt its work and immediately notifies the supervisor or manager.

[0352] Prompt Sentence Examples

[0353] An example of a prompt using a generative AI model is, "Please create a program that uses EmotionEngine to recognize the worker's emotional state in real time, and suspends the work if the emotional state is 'stressed' or 'anxious'."

[0354] As a result, the system based on this invention is capable of dynamically adjusting work in accordance with the emotional state of the worker, and is expected to improve safety and efficiency.

[0355] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0356] Step 1:

[0357] The user inputs personal information and work experience level using a smartphone or head-mounted display (HMD).

[0358] (Input) User's personal information, work experience level

[0359] (Data processing / data calculation) The entered information is sent to the server and stored in the database.

[0360] (Output) Based on the saved information, the appropriate work route information is ready to be generated.

[0361] Specifically, when a user enters information into an input form and presses the send button, the data is sent to the server.

[0362] Step 2:

[0363] The server generates appropriate work route information based on the user's experience level and transmits it to the terminal.

[0364] (Input) User experience level

[0365] (Data processing and calculation) Based on experience level, it searches for the optimal work route and generates data along with detailed work instructions.

[0366] (Output) The generated work route information is sent to the user's terminal.

[0367] Specifically, the server refers to the database, searches for appropriate work route information, and sends it to the terminal.

[0368] Step 3:

[0369] The device will get your current location in real time and track your progress.

[0370] (Input) GPS data, sensor information

[0371] (Data processing and calculation) Obtain location information in real time, calculate progress and send it to the server.

[0372] (Output) Sends the current progress data to the server.

[0373] Specifically, the device periodically obtains location information from GPS and calculates progress.

[0374] Step 4:

[0375] The server shares the user's location and progress with emergency contacts in real time.

[0376] (Input) Location information, progress data

[0377] (Data processing and calculation) Location information and progress status are compiled and notified to designated emergency contacts.

[0378] (Output) Real-time notification to emergency contacts.

[0379] Specifically, the server periodically sends information to the emergency contact.

[0380] Step 5:

[0381] The emotion engine recognizes and analyzes the user's emotional state on the device.

[0382] (Input) Facial expression data, voice data, heart rate data

[0383] (Data processing and calculation) Analyze facial expressions, voice, and heart rate data to classify emotional states.

[0384] (Output) Send the analyzed emotional state data to the server.

[0385] Specifically, the device collects data using the camera, microphone, and sensors, and the emotion engine analyzes it.

[0386] Step 6:

[0387] The server changes the work instructions of the factory robot depending on the emotional state.

[0388] (Input) Emotional state data

[0389] (Data processing / data calculation) Based on emotional state data, instructions are generated to change the robot's operating parameters.

[0390] (Output) Instructions for the robot

[0391] Specifically, the server sends new motion instructions to the robot's control system, and the robot adjusts its motion according to those instructions.

[0392] The above are the specific processing steps in this system, which enables dynamic work adjustments in line with the emotional state of the worker.

[0393] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0394] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0395] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0396] [Second embodiment]

[0397] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0398] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0399] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0400] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0401] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0402] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0403] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0404] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0405] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0406] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0407] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0408] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0409] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone devices. Specific program processing of this system is described below.

[0410] 1. User registration and initial settings

[0411] Users install the app and enter their personal information and climbing experience level, which is then used to suggest suitable climbing routes and respond in emergencies.

[0412] 2. Route selection and information provision

[0413] The user selects a climbing route suitable for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.).

[0414] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[0415] 3. Start of climbing and measuring course time

[0416] On the day of the climb, when the user presses the "Start Climbing" button on the app, the smartphone activates the GPS and tracks the user's current location in real time. The device then sends the user's progress to the server and measures the course time.

[0417] Example: When a user presses the "Start climbing" button at the start of a mountain climb, the smartphone device acquires location information and determines the user's current location in real time. It also calculates the difference between the planned course time and actual progress, and notifies the user of delays and progress.

[0418] 4. Sharing progress and emergency response

[0419] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0420] Example: The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[0421] This allows climbers to enjoy climbing with peace of mind and enables immediate response in the event of an emergency. Furthermore, by providing information on each step and tracking their location in real time, the system provides a safer climbing experience. This system is especially beneficial for beginners and inexperienced climbers, encouraging them to climb without straining themselves.

[0422] The processing flow will be explained below.

[0423] Step 1:

[0424] A user installs the app and creates an account. The user enters personal information (such as name, contact details, and experience level) and sets up the account.

[0425] Step 2:

[0426] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[0427] Step 3:

[0428] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[0429] Step 4:

[0430] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[0431] Step 5:

[0432] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[0433] Step 6:

[0434] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[0435] Step 7:

[0436] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[0437] Step 8:

[0438] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[0439] Step 9:

[0440] The smartphone device measures the user's course time, evaluates their progress, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[0441] Step 10:

[0442] In the unlikely event of an accident, the server will automatically send the user's location information and emergency alert to emergency contacts, enabling a rapid response.

[0443] In this way, through the processing of each step, climbers can enjoy climbing safely and a system is provided that allows for quick response in the event of an emergency.

[0444] Example 1

[0445] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0446] Current mountain climbing support systems have difficulty selecting the optimal route based on the user's climbing experience and skills, and do not adequately track the user's location and share their progress in real time during the climb, which can delay emergency response.In addition, there is no appropriate notification system in place that reflects the user's progress, making it difficult to fully ensure the safety of climbers.

[0447] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0448] In this invention, the server includes means for inputting and saving the user's personal information and climbing experience level, and selecting and providing a route based on that information; means for acquiring the user's current location and tracking progress in real time; means for sharing the user's climbing location information with designated contacts in real time; and means for calculating the difference between the planned course time and actual progress based on the user's progress and notifying the user of the difference. This allows the server to provide the optimal climbing route based on the user's experience, and real-time location tracking and progress sharing enable rapid response in emergencies. Furthermore, appropriate notifications based on progress can increase the safety of climbers.

[0449] "User" refers to an individual who uses the mountain climbing support system.

[0450] "Experience level" refers to a standard for classifying a user's mountaineering experience and skill level.

[0451] "Mountain climbing route information" refers to the route and related information when a user goes mountain climbing (route map, list of items to bring, rest points, information on tent sites and mountain huts, etc.).

[0452] "Current location" refers to geographical information that indicates where the user is in real time while climbing a mountain.

[0453] "Progress" refers to the state that indicates how much progress the user has made while climbing.

[0454] "Real-time" refers to the fact that the user's current location and progress are known immediately and without delay.

[0455] "Designated Contact" refers to a person or organization registered with whom you share your location information in case of an emergency, etc.

[0456] "Personal information" refers to information that identifies an individual user, such as the user's name and contact information.

[0457] "Server" refers to a computer system that processes and stores data from users and provides necessary information.

[0458] "GPS" stands for Global Positioning System, a satellite navigation system for determining location on Earth.

[0459] "Discrepancy" refers to the difference in time or distance between the scheduled course time and the user's actual progress.

[0460] "Notification" refers to a message or alert that the system uses to immediately inform the user of important information.

[0461] "Course time" refers to the estimated time that indicates how long it will take the user to complete each section of the mountain climb.

[0462] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone terminals. Specific program processing of this system is described below.

[0463] User registration and initial settings

[0464] Users install a mountaineering support app on their smartphone and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond in emergencies. The device sends this data to a server, which stores it in a database.

[0465] Specific examples

[0466] The user installs the app and enters their name, phone number, and the fact that they are a beginner climber. The device sends this information to the server, which then stores it.

[0467] Route selection and information provision

[0468] The user selects a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app. Based on this selection, the server sends the necessary route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) to the device.

[0469] Specific examples

[0470] When a beginner user selects a "Level 1" route in the app, the server displays a detailed map from the entry point to the finish line, a list of items to bring, and appropriate rest stops on the device.

[0471] Start of climbing and course time measurement

[0472] When the user starts climbing, they press the "Start Climbing" button on the app. This activates the device's GPS and tracks the user's current location in real time. The device periodically sends the user's progress to the server, which uses this information to measure the course time. The device also notifies the user if their progress is slow or too fast.

[0473] Specific examples

[0474] When the user presses the "Start Climbing" button to begin climbing, the device acquires location information and grasps the user's location in real time. It calculates the difference between the planned course time and the actual progress and sends a notification of this to the device.

[0475] Sharing progress and responding to emergencies

[0476] The server periodically shares the user's location information with emergency contacts, enabling a rapid response in the unlikely event of an accident. Emergency contacts can check the user's location and progress in real time via a webpage or dedicated app. If the user significantly exceeds the scheduled course time, an automatic alert is sent, urging a rapid response.

[0477] Specific examples

[0478] The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[0479] Prompt Sentence Examples

[0480] Examples of prompts to input to a generative AI model include:

[0481] "Please explain how a system that provides a safe mountain climbing experience for beginner climbers works. The system begins by the user registering their personal information and climbing experience level on their smartphone and selecting an appropriate climbing route. Once the climb begins, the system uses GPS to track the user's location in real time, sending their progress to a server and sharing their location with emergency contacts. It is designed to ensure a rapid response in the event of an emergency."

[0482] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0483] Step 1:

[0484] The user installs a mountain climbing support app on their smartphone and enters their personal information and mountain climbing experience level.

[0485] Input: User's name, contact information, and climbing experience level.

[0486] Data processing and output: The terminal processes the input data and sends it to the server, which receives it and stores it in a database.

[0487] Specific actions

[0488] 1. A user downloads an app from the App Store or Google Play.

[0489] 2. The user launches the app and enters their name, contact information, and climbing experience.

[0490] 3. The device sends this data to the server, which receives it and stores it in a database.

[0491] Step 2:

[0492] Users select a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app.

[0493] Input: The user's climbing experience level.

[0494] Data processing and output: The server selects an appropriate climbing route based on the user's experience level, generates route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.), and sends it to the device.

[0495] Specific actions

[0496] 1. The user opens the "Route Selection" menu.

[0497] 2. The user selects a route appropriate for their experience level, e.g. "Level 1".

[0498] 3. The server generates route information based on the selected route and sends it to the terminal.

[0499] 4. The device displays the route information to the user.

[0500] Step 3:

[0501] When the user starts climbing, they press the "Start Climbing" button on the app.

[0502] Input: Press the Start Climbing button.

[0503] Data processing and output: The device activates the GPS, acquires the user's current location, and sends it to the server. The server receives this information and starts measuring the course time.

[0504] Specific actions

[0505] 1. The user presses the "Start climbing" button in the app.

[0506] 2. The device activates the GPS and acquires location information.

[0507] 3. The device periodically sends location information to the server.

[0508] 4. The server receives the location information and measures the course time.

[0509] Step 4:

[0510] The server checks the user's progress and calculates the difference between the planned course time and the actual progress.

[0511] Input: User's real-time location data.

[0512] Data processing and output: The server compares the time with the planned course time, calculates the discrepancy, and notifies the terminal of the result.

[0513] Specific actions

[0514] 1. The server receives location information sent at regular intervals.

[0515] 2. The server calculates the difference between the scheduled course time and the actual progress.

[0516] 3. The server notifies the device of the deviation result.

[0517] Step 5:

[0518] The server periodically shares the user's location information with emergency contacts.

[0519] Input: User's location, emergency contact information.

[0520] Data processing and output: The server sends location information to emergency contacts and generates alerts as needed.

[0521] Specific actions

[0522] 1. The server periodically updates the user's location.

[0523] 2. The server sends the location information to the emergency contact.

[0524] 3. The emergency contact user checks the user's location through a dedicated web page or app.

[0525] 4. The server automatically sends an alert if the user significantly exceeds the scheduled course time.

[0526] (Application example 1)

[0527] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0528] In today's mountaineering environment, ensuring climber safety and responding quickly in emergencies are essential, but there are limited systems that can effectively achieve this. Furthermore, there is a lack of appropriate route suggestions and progress management for beginners and inexperienced climbers, increasing the risk of accidents during mountaineering. To solve these problems, a system with real-time location tracking and automatic notification to emergency contacts is needed.

[0529] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0530] In this invention, the server includes a means for providing appropriate mountain climbing route information based on the user's experience level, a means for acquiring the user's current location and tracking the user's progress in real time, a means for sharing the user's mountain climbing location information with designated contacts in real time, and a means for automatically issuing alerts in the event of an emergency. This ensures the safety of the climber, enables rapid emergency response, and enables a natural mountain climbing activity through route suggestions.

[0531] A "user" is an individual climber who uses the system, inputs the necessary information, and enjoys a safe climbing experience.

[0532] "Mountain climbing route information" refers to information such as guidelines, a list of items to bring, and rest points necessary for mountain climbing, which are provided based on the user's experience level and selection.

[0533] "Current location" refers to the climber's real-time geographic location, obtained using technology such as GPS.

[0534] "Progress" refers to information such as where a climber is along the climbing route, the difference between planned and actual progress, and so on.

[0535] "Designated Contacts" are the climber's registered emergency contacts, which may include family, friends, or rescue agencies.

[0536] "Means for automatically sending alerts in emergencies" is a function that automatically sends a warning to registered emergency contacts when a situation that threatens the safety of climbers is detected.

[0537] "Behavior management" is the process of tracking a user's progress and behavior and ensuring adherence to planned schedules and routes.

[0538] "Course time" refers to the estimated or actual time required to reach the destination from the starting point of a climb.

[0539] A "server" is a central processing unit that provides information, tracks locations, manages progress, etc. based on requests from users.

[0540] To implement the present invention, a system program is required that performs the following steps in order.

[0541] Program processing overview

[0542] User registration and initial settings

[0543] After installing the smartphone app, users input their personal information and climbing experience level, which is then sent to the server, where appropriate initial settings are made.

[0544] Route selection and information provision

[0545] The server provides climbing route information based on the user's experience level. Specifically, the server selects an appropriate route from a pre-prepared route database and sends it to the user's smartphone along with a list of items to bring, information on rest points, tent sites, and mountain huts.

[0546] Start climbing and track location

[0547] When a user presses the "Start Climbing" button, the smartphone's GPS function is activated and the current location is sent to the server in real time. The server analyzes the progress and shares the user's location information with designated contacts.

[0548] Emergency response

[0549] The server periodically manages the user's progress and location information, and has a means to automatically send alerts in the event of an emergency, so that designated contacts are promptly notified of the emergency situation.

[0550] Hardware and software used

[0551] Hardware

[0552] Smartphones: Equipped with a built-in GPS module for obtaining location information (e.g., iPhone, Android devices).

[0553] Smart glasses: Provide visual information needed while climbing (e.g. Google Glass).

[0554] Head-mounted displays: Showing real-time maps and route information (e.g., HoloLens).

[0555] software

[0556] Server: A central management system that provides information, location tracking, and emergency notifications (e.g., AWS, Google Cloud Platform).

[0557] Mobile app development platform: Used to develop applications (e.g., React Native, Flutter).

[0558] Notification system: Provides periodic updates and alerts (e.g., Firebase Cloud Messaging).

[0559] Examples

[0560] For example, when a beginner climber climbs a mountain for the first time, they use the app to select a route and begin climbing based on the route information provided by the server. As they climb, their smartphone tracks the user's location in real time and periodically sends the location information to the server. The server analyzes this information and notifies the user's family of their progress in real time. In the unlikely event of an accident or overrun, an emergency alert is automatically sent to the family's smartphone.

[0561] Prompt Sentence Examples

[0562] "The following application will have real-time tracking and emergency alert functions to ensure the safety of climbers. Specific functions include user registration, climbing route selection, GPS tracking, and real-time location sharing. Please provide the program code to implement this."

[0563] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0564] Step 1:

[0565] A user installs the app on their smartphone and enters their personal information and climbing experience level. This information is sent from the device to the server. The input data includes the user's name, contact information, and past climbing experience (beginner, intermediate, advanced). The server receives this data and generates a user profile.

[0566] Step 2:

[0567] The user selects a mountain climbing route suitable for their experience level from the "Route Selection" menu within the app. The server generates appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) based on the selected experience level. The user's experience level and selected route are provided to the server as input, and the server retrieves the relevant route information from its internal database and sends it to the device.

[0568] Step 3:

[0569] When a user presses the "Start Mountain Climbing" button on their smartphone, the device activates its GPS function and acquires their current location. GPS data (latitude, longitude, altitude, etc.) is sent to the server in real time. The server receives input data, including location information from the GPS, and tracks the user's progress.

[0570] Step 4:

[0571] The server analyzes the user's progress based on the received current location data. The server compares the user's progress against the scheduled course time and evaluates progress and delays. Input data includes GPS location information and the pre-set course time, and output data includes progress and delays sent to the device.

[0572] Step 5:

[0573] The server periodically sends the user's progress and location to a designated emergency contact. Input data includes the current location and progress, and output includes notifications to the emergency contact. The server uses a notification system such as Firebase Cloud Messaging to notify the designated contact of the progress.

[0574] Step 6:

[0575] If a user significantly exceeds the scheduled course time, the server will automatically send an emergency alert. Input data includes the user's current location and calculated progress, and output includes an emergency notification to emergency contacts. This allows registered emergency contacts to be alerted immediately and promptly respond.

[0576] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0577] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. Specific program processing of this system is described below.

[0578] 1. User registration and initial settings

[0579] Users install the app and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond to emergencies. Users can also set emergency contacts (family or acquaintances) to ensure quick contact in case of emergency.

[0580] 2. Route selection and information provision

[0581] The user selects a mountain climbing route appropriate for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides the user's app with appropriate route information (route map, necessary items, rest points, information on tent sites and mountain huts, etc.).

[0582] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[0583] 3. Start of climbing and measuring course time

[0584] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts recording the climb and enables the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[0585] 4. Sharing progress and emergency response

[0586] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0587] 5. Incorporating an Emotional Engine

[0588] The emotion engine is installed in the smartphone and recognizes the user's emotions. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[0589] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[0590] 6. Emotion data contact sharing

[0591] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[0592] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[0593] 7. Comprehensive Safety Assessment and Emergency Measures

[0594] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[0595] Example: If the server determines, based on the user's emotional and progress data, that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[0596] In this way, by incorporating an emotion engine, climbers' safety can be managed more meticulously, allowing them to enjoy mountain climbing with peace of mind. Furthermore, we have built a system that can respond quickly in the unlikely event of an emergency.

[0597] The processing flow will be explained below.

[0598] Step 1:

[0599] A user installs the app, creates an account, and enters personal information (such as name, contact details, and experience level) to set up the account.

[0600] Step 2:

[0601] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[0602] Step 3:

[0603] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[0604] Step 4:

[0605] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[0606] Step 5:

[0607] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[0608] Step 6:

[0609] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[0610] Step 7:

[0611] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[0612] Step 8:

[0613] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[0614] Step 9:

[0615] The smartphone device manages the user's actions, measures the course time, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[0616] Step 10:

[0617] The emotion engine installed in the smartphone recognizes the user's emotions and analyzes data such as the user's facial expressions, voice, and heart rate to determine the user's current emotional state.

[0618] Step 11:

[0619] The smartphone device transmits the emotional state recognized by the emotion engine to the server, which allows the server to grasp the user's emotional state.

[0620] Step 12:

[0621] The server shares the emotional information recognized by the emotion engine with designated contacts in real time, allowing emergency contacts to check the user's emotional state.

[0622] Step 13:

[0623] The server integrates the emotional data and location information to make a comprehensive safety assessment, and takes emergency measures if it determines that the user is in danger.

[0624] Step 14:

[0625] In the event of an accident or if the user is in an extremely unstable emotional state, the server automatically sends a notification to emergency contacts and prepares to dispatch a rescue team if necessary.

[0626] In this way, by incorporating an emotion engine, the system can grasp the emotional state of climbers in real time, provide appropriate support and emergency measures, and provide a safer climbing experience.

[0627] Example 2

[0628] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0629] To effectively manage the safety of climbers, it is important to provide appropriate route information according to their experience level and to grasp their location information in real time. Furthermore, to respond quickly to emergencies, it is necessary to share the user's location and progress with relevant parties. Furthermore, it is also necessary to continuously monitor the user's emotional state while climbing and detect abnormalities early. However, there has been no previous system that provides comprehensive support and manages all of these in a unified manner.

[0630] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for providing appropriate route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's location information and emotional information with designated contacts in real time, means for using an emotion engine to analyze the user's emotional state, and means for performing a comprehensive safety assessment based on the user's location information and emotional information and taking emergency measures. This enables advanced management of climber safety and rapid response in emergencies.

[0631] A "user" is an individual who uses this system to go mountain climbing.

[0632] "Experience level" is an index that indicates the user's mountain climbing experience, and includes levels such as beginner, intermediate, and advanced.

[0633] "Route information" refers to detailed information about mountain climbing routes, including route maps, necessary items to bring, rest points, and information on tent sites and mountain huts.

[0634] "Current location" is location information of the location where the user is currently located, and is obtained using GPS.

[0635] "Progress status" refers to a state that includes information such as where the user is on the mountain climbing route and progress over time.

[0636] "Real-time" refers to the fact that data is sent and received almost instantaneously, meaning that the latest information is updated without delay.

[0637] "Contacts" refers to information about individuals or organizations that a user has registered to be contacted in an emergency.

[0638] An "emotion engine" is software or hardware that analyzes a user's emotional state, using data such as facial expressions, voice, and heart rate.

[0639] "Emotion information" is data that indicates the user's current emotional state as a result of analysis by the emotion engine.

[0640] "Safety assessment" is a process of assessing the safety of a user while climbing a mountain based on the user's location information and emotional information.

[0641] "Emergency measures" are measures that are taken immediately when it is determined that the user is in danger, and include notifying contacts and dispatching a rescue team.

[0642] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. A specific embodiment of this system will be described below.

[0643] User registration and initial settings

[0644] First, users install the app on their smartphone. After launching the app, they enter their personal information and climbing experience level. This information is later used to suggest suitable climbing routes and respond to emergencies. Users also set up emergency contacts (family or acquaintances) so they can be contacted immediately if necessary.

[0645] Route selection and information provision

[0646] When a user opens the "Route Selection" menu in the app, the server filters suitable climbing routes based on the user's experience level and current location. When the user selects one of the suggested routes, the server provides detailed information about that route (route map, necessary items, rest points, information on tent sites and mountain huts, etc.) to the user's smartphone.

[0647] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1," including a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest stops.

[0648] Start of climbing and course time measurement

[0649] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts the climb recording and activates the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[0650] Sharing progress and responding to emergencies

[0651] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0652] Incorporating an emotion engine

[0653] The emotion engine is installed in the smartphone and recognizes the user's emotional state. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[0654] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[0655] Emotion data contact sharing

[0656] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[0657] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[0658] Comprehensive safety assessment and emergency measures

[0659] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[0660] Example: If the server determines based on the user's emotional and progress data that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[0661] Example prompt

[0662] The prompt sentences to input to the generative AI model are shown below.

[0663] Please explain the program processing for the following system in natural language. Please write so that the subject is either the server, the terminal, or the user. Please write sentence endings in the plain style.

[0664] (System) The system of this invention provides climbers with a safe and effective mountain climbing experience through collaboration between users, servers, smartphone devices, and an emotion engine.

[0665] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0666] Step 1: User registration and initial setup

[0667] The user installs the app on their smartphone. After installation is complete, the user launches the app and enters personal information such as name, age, gender, and emergency contact information, as well as their climbing experience level. This information is sent to a server and used to suggest appropriate climbing routes and respond in emergencies.

[0668] Input: Personal information (name, age, gender, emergency contact information), climbing experience level

[0669] Output: User information stored on the server

[0670] Specific operation: When the user enters information and presses the submit button, the server saves the information in a database.

[0671] Step 2: Route selection and information provision

[0672] The user opens the "Route Selection" menu in the app and selects a climbing route. The server filters and suggests suitable climbing routes based on the user's experience level and current location. Once the user selects a route, the server generates detailed route information and sends it to the smartphone device.

[0673] Input: current location, experience level

[0674] Output: Appropriate hiking route information (route map, packing list, rest points, etc.)

[0675] Specific operation: The server extracts the appropriate route from the database, generates detailed information and sends it to the user.

[0676] Step 3: Start climbing and measure course time

[0677] On the day of the climb, the user presses the "Start Climbing" button on the app. The smartphone activates GPS and acquires the user's current location in real time. The acquired location information is sent to a server and used to track progress.

[0678] Input: GPS data (current location)

[0679] Output: Real-time location data

[0680] Specific operation: The smartphone device periodically measures its current location and sends that data to the server.

[0681] Step 4: Sharing progress and emergency response

[0682] The server periodically acquires the user's location information and shares it with emergency contacts in real time. If an abnormality is detected in the user's progress, an alert will be sent to the emergency contacts.

[0683] Input: User's location

[0684] Output: Location sharing data to emergency contacts, alerts

[0685] Specific operation: The server analyzes the location information and notifies emergency contacts if there is an abnormality.

[0686] Step 5: Incorporating the Emotion Engine

[0687] The smartphone device is equipped with an emotion engine that analyzes the user's emotional state based on facial expressions, voice, heart rate, etc. The emotion engine sends the results to a server, which uses them for safety management.

[0688] Input: facial expression data, voice data, heart rate data

[0689] Output: Emotional state data

[0690] Specific operation: The smartphone device's sensors collect data, the emotion engine analyzes it, and sends the results to the server.

[0691] Step 6: Share emotion data with contacts

[0692] The server shares the user's emotional information recognized by the emotion engine with emergency contacts in real time. Designated family members and acquaintances can check the user's emotional state and take prompt action if necessary.

[0693] Input: Emotional state data

[0694] Output: Shared emotional state information

[0695] Specific operation: The server extracts the emotion data and sends it to the emergency contact.

[0696] Step 7: Comprehensive safety assessment and emergency measures

[0697] The server integrates the user's location and emotional data to provide a comprehensive safety assessment. If the server determines that the user is in danger, it immediately takes emergency measures, contacting emergency contacts and dispatching rescue teams if necessary.

[0698] Input: location data, emotional state data

[0699] Output: Safety assessment results, emergency measures

[0700] Specific operation: The server analyzes the data and immediately initiates emergency response procedures if a danger is detected.

[0701] Through the above steps, the system of the present invention can manage the safety of climbers in a sophisticated manner and can respond quickly in the event of an emergency.

[0702] (Application example 2)

[0703] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0704] Conventional systems lack the ability to appropriately recognize the emotional state of factory workers and dynamically adjust robot work instructions based on that state. As a result, when workers feel stressed or fatigued, not only does it become difficult to work efficiently, but safety also decreases. The present invention aims to solve these problems by providing a system that recognizes the emotional state of workers and adjusts work based on that state.

[0705] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0706] In this invention, the server includes means for providing appropriate work route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's work location information with designated contacts in real time, emotion processing means for recognizing and analyzing the user's emotional state, and control means for changing work instructions according to the emotional state, thereby enabling dynamic work adjustments in line with the worker's emotional state, improving safety and efficiency.

[0707] The "user experience level" is an index that indicates the worker's past work experience and skill level.

[0708] "Work route information" is information about a series of procedures and routes for workers to carry out work efficiently and safely.

[0709] "Current location" is information that indicates the exact location where the worker is currently located within the factory.

[0710] "Progress" is information that indicates the state and progress of the work process that the worker is currently in progress.

[0711] "Work location information" is information about the location where a worker is working within a factory.

[0712] "Designated Contacts" are people or departments designated to receive notification in the event of an emergency or other need.

[0713] "Emotional state" refers to the worker's current psychological state, and includes stress, fatigue, joy, etc.

[0714] "Emotion processing means" refers to techniques and methods for analyzing data such as a worker's facial expression, voice, and heart rate to recognize their emotional state.

[0715] "Control means" refers to techniques and methods for dynamically adjusting work instructions and robot behavior based on the acquired emotional state.

[0716] The system for realizing this invention mainly consists of three elements: a server, a terminal, and a user. Specifically, it provides appropriate work route information based on the user's experience level, acquires the user's current location, and tracks the user's progress in real time. It also includes a control system that recognizes the user's emotional state and dynamically changes work instructions based on that state.

[0717] Explanation of program processing

[0718] Hardware and Software Use

[0719] The hardware of the entire system includes a smartphone and head-mounted display (HMD) worn by the user, communication modules (Wi-Fi, Bluetooth, etc.) placed in the work environment, and sensors for measuring emotions (heart rate monitor, microphone, camera).The factory robot is managed using ROS (Robot Operating System).

[0720] Data processing and calculation

[0721] The server generates appropriate work route information based on the user's experience level and sends it to the device. The user's progress is captured in real time using GPS and internal sensors, and the results are periodically sent to the server. The server also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, etc. to identify and record their emotional state. Based on the emotional state, the server sends appropriate instructions to the factory robot and dynamically adjusts the robot's operation.

[0722] Use case details

[0723] Specific use cases include the following: If the emotion engine recognizes a user's stress level from their facial expressions or voice, the server immediately acquires the data and adjusts the working robot's movement speed to a slower speed. Also, if the user's heart rate is abnormally high, the server sends an instruction to the robot to temporarily halt its work and immediately notifies the supervisor or manager.

[0724] Prompt Sentence Examples

[0725] An example of a prompt using a generative AI model is, "Please create a program that uses EmotionEngine to recognize the worker's emotional state in real time, and suspends the work if the emotional state is 'stressed' or 'anxious'."

[0726] As a result, the system based on this invention is capable of dynamically adjusting work in accordance with the emotional state of the worker, and is expected to improve safety and efficiency.

[0727] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0728] Step 1:

[0729] The user inputs personal information and work experience level using a smartphone or head-mounted display (HMD).

[0730] (Input) User's personal information, work experience level

[0731] (Data processing / data calculation) The entered information is sent to the server and stored in the database.

[0732] (Output) Based on the saved information, the appropriate work route information is ready to be generated.

[0733] Specifically, when a user enters information into an input form and presses the send button, the data is sent to the server.

[0734] Step 2:

[0735] The server generates appropriate work route information based on the user's experience level and transmits it to the terminal.

[0736] (Input) User experience level

[0737] (Data processing and calculation) Based on experience level, it searches for the optimal work route and generates data along with detailed work instructions.

[0738] (Output) The generated work route information is sent to the user's terminal.

[0739] Specifically, the server refers to the database, searches for appropriate work route information, and sends it to the terminal.

[0740] Step 3:

[0741] The device will get your current location in real time and track your progress.

[0742] (Input) GPS data, sensor information

[0743] (Data processing and calculation) Obtain location information in real time, calculate progress and send it to the server.

[0744] (Output) Sends the current progress data to the server.

[0745] Specifically, the device periodically obtains location information from GPS and calculates progress.

[0746] Step 4:

[0747] The server shares the user's location and progress with emergency contacts in real time.

[0748] (Input) Location information, progress data

[0749] (Data processing and calculation) Location information and progress status are compiled and notified to designated emergency contacts.

[0750] (Output) Real-time notification to emergency contacts.

[0751] Specifically, the server periodically sends information to the emergency contact.

[0752] Step 5:

[0753] The emotion engine recognizes and analyzes the user's emotional state on the device.

[0754] (Input) Facial expression data, voice data, heart rate data

[0755] (Data processing and calculation) Analyze facial expressions, voice, and heart rate data to classify emotional states.

[0756] (Output) Send the analyzed emotional state data to the server.

[0757] Specifically, the device collects data using the camera, microphone, and sensors, and the emotion engine analyzes it.

[0758] Step 6:

[0759] The server changes the work instructions of the factory robot depending on the emotional state.

[0760] (Input) Emotional state data

[0761] (Data processing / data calculation) Based on emotional state data, instructions are generated to change the robot's operating parameters.

[0762] (Output) Instructions for the robot

[0763] Specifically, the server sends new motion instructions to the robot's control system, and the robot adjusts its motion according to those instructions.

[0764] The above are the specific processing steps in this system, which enables dynamic work adjustments in line with the emotional state of the worker.

[0765] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0766] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0767] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0768] [Third embodiment]

[0769] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0770] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0771] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0772] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0773] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0774] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0775] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0776] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0777] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0778] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0779] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0780] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0781] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone devices. Specific program processing of this system is described below.

[0782] 1. User registration and initial settings

[0783] Users install the app and enter their personal information and climbing experience level, which is then used to suggest suitable climbing routes and respond in emergencies.

[0784] 2. Route selection and information provision

[0785] The user selects a climbing route suitable for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.).

[0786] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[0787] 3. Start of climbing and measuring course time

[0788] On the day of the climb, when the user presses the "Start Climbing" button on the app, the smartphone activates the GPS and tracks the user's current location in real time. The device then sends the user's progress to the server and measures the course time.

[0789] Example: When a user presses the "Start climbing" button at the start of a mountain climb, the smartphone device acquires location information and determines the user's current location in real time. It also calculates the difference between the planned course time and actual progress, and notifies the user of delays and progress.

[0790] 4. Sharing progress and emergency response

[0791] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0792] Example: The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[0793] This allows climbers to enjoy climbing with peace of mind and enables immediate response in the event of an emergency. Furthermore, by providing information on each step and tracking their location in real time, the system provides a safer climbing experience. This system is especially beneficial for beginners and inexperienced climbers, encouraging them to climb without straining themselves.

[0794] The processing flow will be explained below.

[0795] Step 1:

[0796] A user installs the app and creates an account. The user enters personal information (such as name, contact details, and experience level) and sets up the account.

[0797] Step 2:

[0798] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[0799] Step 3:

[0800] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[0801] Step 4:

[0802] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[0803] Step 5:

[0804] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[0805] Step 6:

[0806] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[0807] Step 7:

[0808] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[0809] Step 8:

[0810] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[0811] Step 9:

[0812] The smartphone device measures the user's course time, evaluates their progress, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[0813] Step 10:

[0814] In the unlikely event of an accident, the server will automatically send the user's location information and emergency alert to emergency contacts, enabling a rapid response.

[0815] In this way, through the processing of each step, climbers can enjoy climbing safely and a system is provided that allows for quick response in the event of an emergency.

[0816] Example 1

[0817] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0818] Current mountain climbing support systems have difficulty selecting the optimal route based on the user's climbing experience and skills, and do not adequately track the user's location and share their progress in real time during the climb, which can delay emergency response.In addition, there is no appropriate notification system in place that reflects the user's progress, making it difficult to fully ensure the safety of climbers.

[0819] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0820] In this invention, the server includes means for inputting and saving the user's personal information and climbing experience level, and selecting and providing a route based on that information; means for acquiring the user's current location and tracking progress in real time; means for sharing the user's climbing location information with designated contacts in real time; and means for calculating the difference between the planned course time and actual progress based on the user's progress and notifying the user of the difference. This allows the server to provide the optimal climbing route based on the user's experience, and real-time location tracking and progress sharing enable rapid response in emergencies. Furthermore, appropriate notifications based on progress can increase the safety of climbers.

[0821] "User" refers to an individual who uses the mountain climbing support system.

[0822] "Experience level" refers to a standard for classifying a user's mountaineering experience and skill level.

[0823] "Mountain climbing route information" refers to the route and related information when a user goes mountain climbing (route map, list of items to bring, rest points, information on tent sites and mountain huts, etc.).

[0824] "Current location" refers to geographical information that indicates where the user is in real time while climbing a mountain.

[0825] "Progress" refers to the state that indicates how much progress the user has made while climbing.

[0826] "Real-time" refers to the fact that the user's current location and progress are known immediately and without delay.

[0827] "Designated Contact" refers to a person or organization registered with whom you share your location information in case of an emergency, etc.

[0828] "Personal information" refers to information that identifies an individual user, such as the user's name and contact information.

[0829] "Server" refers to a computer system that processes and stores data from users and provides necessary information.

[0830] "GPS" stands for Global Positioning System, a satellite navigation system for determining location on Earth.

[0831] "Discrepancy" refers to the difference in time or distance between the scheduled course time and the user's actual progress.

[0832] "Notification" refers to a message or alert that the system uses to immediately inform the user of important information.

[0833] "Course time" refers to the estimated time that indicates how long it will take the user to complete each section of the mountain climb.

[0834] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone terminals. Specific program processing of this system is described below.

[0835] User registration and initial settings

[0836] Users install a mountaineering support app on their smartphone and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond in emergencies. The device sends this data to a server, which stores it in a database.

[0837] Specific examples

[0838] The user installs the app and enters their name, phone number, and the fact that they are a beginner climber. The device sends this information to the server, which then stores it.

[0839] Route selection and information provision

[0840] The user selects a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app. Based on this selection, the server sends the necessary route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) to the device.

[0841] Specific examples

[0842] When a beginner user selects a "Level 1" route in the app, the server displays a detailed map from the entry point to the finish line, a list of items to bring, and appropriate rest stops on the device.

[0843] Start of climbing and course time measurement

[0844] When the user starts climbing, they press the "Start Climbing" button on the app. This activates the device's GPS and tracks the user's current location in real time. The device periodically sends the user's progress to the server, which uses this information to measure the course time. The device also notifies the user if their progress is slow or too fast.

[0845] Specific examples

[0846] When the user presses the "Start Climbing" button to begin climbing, the device acquires location information and grasps the user's location in real time. It calculates the difference between the planned course time and the actual progress and sends a notification of this to the device.

[0847] Sharing progress and responding to emergencies

[0848] The server periodically shares the user's location information with emergency contacts, enabling a rapid response in the unlikely event of an accident. Emergency contacts can check the user's location and progress in real time via a webpage or dedicated app. If the user significantly exceeds the scheduled course time, an automatic alert is sent, urging a rapid response.

[0849] Specific examples

[0850] The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[0851] Prompt Sentence Examples

[0852] Examples of prompts to input to a generative AI model include:

[0853] "Please explain how a system that provides a safe mountain climbing experience for beginner climbers works. The system begins by the user registering their personal information and climbing experience level on their smartphone and selecting an appropriate climbing route. Once the climb begins, the system uses GPS to track the user's location in real time, sending their progress to a server and sharing their location with emergency contacts. It is designed to ensure a rapid response in the event of an emergency."

[0854] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0855] Step 1:

[0856] The user installs a mountain climbing support app on their smartphone and enters their personal information and mountain climbing experience level.

[0857] Input: User's name, contact information, and climbing experience level.

[0858] Data processing and output: The terminal processes the input data and sends it to the server, which receives it and stores it in a database.

[0859] Specific actions

[0860] 1. A user downloads an app from the App Store or Google Play.

[0861] 2. The user launches the app and enters their name, contact information, and climbing experience.

[0862] 3. The device sends this data to the server, which receives it and stores it in a database.

[0863] Step 2:

[0864] Users select a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app.

[0865] Input: The user's climbing experience level.

[0866] Data processing and output: The server selects an appropriate climbing route based on the user's experience level, generates route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.), and sends it to the device.

[0867] Specific actions

[0868] 1. The user opens the "Route Selection" menu.

[0869] 2. The user selects a route appropriate for their experience level, e.g. "Level 1".

[0870] 3. The server generates route information based on the selected route and sends it to the terminal.

[0871] 4. The device displays the route information to the user.

[0872] Step 3:

[0873] When the user starts climbing, they press the "Start Climbing" button on the app.

[0874] Input: Press the Start Climbing button.

[0875] Data processing and output: The device activates the GPS, acquires the user's current location, and sends it to the server. The server receives this information and starts measuring the course time.

[0876] Specific actions

[0877] 1. The user presses the "Start climbing" button in the app.

[0878] 2. The device activates the GPS and acquires location information.

[0879] 3. The device periodically sends location information to the server.

[0880] 4. The server receives the location information and measures the course time.

[0881] Step 4:

[0882] The server checks the user's progress and calculates the difference between the planned course time and the actual progress.

[0883] Input: User's real-time location data.

[0884] Data processing and output: The server compares the time with the planned course time, calculates the discrepancy, and notifies the terminal of the result.

[0885] Specific actions

[0886] 1. The server receives location information sent at regular intervals.

[0887] 2. The server calculates the difference between the scheduled course time and the actual progress.

[0888] 3. The server notifies the device of the deviation result.

[0889] Step 5:

[0890] The server periodically shares the user's location information with emergency contacts.

[0891] Input: User's location, emergency contact information.

[0892] Data processing and output: The server sends location information to emergency contacts and generates alerts as needed.

[0893] Specific actions

[0894] 1. The server periodically updates the user's location.

[0895] 2. The server sends the location information to the emergency contact.

[0896] 3. The emergency contact user checks the user's location through a dedicated web page or app.

[0897] 4. The server automatically sends an alert if the user significantly exceeds the scheduled course time.

[0898] (Application example 1)

[0899] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0900] In today's mountaineering environment, ensuring climber safety and responding quickly in emergencies are essential, but there are limited systems that can effectively achieve this. Furthermore, there is a lack of appropriate route suggestions and progress management for beginners and inexperienced climbers, increasing the risk of accidents during mountaineering. To solve these problems, a system with real-time location tracking and automatic notification to emergency contacts is needed.

[0901] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0902] In this invention, the server includes a means for providing appropriate mountain climbing route information based on the user's experience level, a means for acquiring the user's current location and tracking the user's progress in real time, a means for sharing the user's mountain climbing location information with designated contacts in real time, and a means for automatically issuing alerts in the event of an emergency. This ensures the safety of the climber, enables rapid emergency response, and enables a natural mountain climbing activity through route suggestions.

[0903] A "user" is an individual climber who uses the system, inputs the necessary information, and enjoys a safe climbing experience.

[0904] "Mountain climbing route information" refers to information such as guidelines, a list of items to bring, and rest points necessary for mountain climbing, which are provided based on the user's experience level and selection.

[0905] "Current location" refers to the climber's real-time geographic location, obtained using technology such as GPS.

[0906] "Progress" refers to information such as where a climber is along the climbing route, the difference between planned and actual progress, and so on.

[0907] "Designated Contacts" are the climber's registered emergency contacts, which may include family, friends, or rescue agencies.

[0908] "Means for automatically sending alerts in emergencies" is a function that automatically sends a warning to registered emergency contacts when a situation that threatens the safety of climbers is detected.

[0909] "Behavior management" is the process of tracking a user's progress and behavior and ensuring adherence to planned schedules and routes.

[0910] "Course time" refers to the estimated or actual time required to reach the destination from the starting point of a climb.

[0911] A "server" is a central processing unit that provides information, tracks locations, manages progress, etc. based on requests from users.

[0912] To implement the present invention, a system program is required that performs the following steps in order.

[0913] Program processing overview

[0914] User registration and initial settings

[0915] After installing the smartphone app, users input their personal information and climbing experience level, which is then sent to the server, where appropriate initial settings are made.

[0916] Route selection and information provision

[0917] The server provides climbing route information based on the user's experience level. Specifically, the server selects an appropriate route from a pre-prepared route database and sends it to the user's smartphone along with a list of items to bring, information on rest points, tent sites, and mountain huts.

[0918] Start climbing and track location

[0919] When a user presses the "Start Climbing" button, the smartphone's GPS function is activated and the current location is sent to the server in real time. The server analyzes the progress and shares the user's location information with designated contacts.

[0920] Emergency response

[0921] The server periodically manages the user's progress and location information, and has a means to automatically send alerts in the event of an emergency, so that designated contacts are promptly notified of the emergency situation.

[0922] Hardware and software used

[0923] Hardware

[0924] Smartphones: Equipped with a built-in GPS module for obtaining location information (e.g., iPhone, Android devices).

[0925] Smart glasses: Provide visual information needed while climbing (e.g. Google Glass).

[0926] Head-mounted displays: Showing real-time maps and route information (e.g., HoloLens).

[0927] software

[0928] Server: A central management system that provides information, location tracking, and emergency notifications (e.g., AWS, Google Cloud Platform).

[0929] Mobile app development platform: Used to develop applications (e.g., React Native, Flutter).

[0930] Notification system: Provides periodic updates and alerts (e.g., Firebase Cloud Messaging).

[0931] Examples

[0932] For example, when a beginner climber climbs a mountain for the first time, they use the app to select a route and begin climbing based on the route information provided by the server. As they climb, their smartphone tracks the user's location in real time and periodically sends the location information to the server. The server analyzes this information and notifies the user's family of their progress in real time. In the unlikely event of an accident or overrun, an emergency alert is automatically sent to the family's smartphone.

[0933] Prompt Sentence Examples

[0934] "The following application will have real-time tracking and emergency alert functions to ensure the safety of climbers. Specific functions include user registration, climbing route selection, GPS tracking, and real-time location sharing. Please provide the program code to implement this."

[0935] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0936] Step 1:

[0937] A user installs the app on their smartphone and enters their personal information and climbing experience level. This information is sent from the device to the server. The input data includes the user's name, contact information, and past climbing experience (beginner, intermediate, advanced). The server receives this data and generates a user profile.

[0938] Step 2:

[0939] The user selects a mountain climbing route suitable for their experience level from the "Route Selection" menu within the app. The server generates appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) based on the selected experience level. The user's experience level and selected route are provided to the server as input, and the server retrieves the relevant route information from its internal database and sends it to the device.

[0940] Step 3:

[0941] When a user presses the "Start Mountain Climbing" button on their smartphone, the device activates its GPS function and acquires their current location. GPS data (latitude, longitude, altitude, etc.) is sent to the server in real time. The server receives input data, including location information from the GPS, and tracks the user's progress.

[0942] Step 4:

[0943] The server analyzes the user's progress based on the received current location data. The server compares the user's progress against the scheduled course time and evaluates progress and delays. Input data includes GPS location information and the pre-set course time, and output data includes progress and delays sent to the device.

[0944] Step 5:

[0945] The server periodically sends the user's progress and location to a designated emergency contact. Input data includes the current location and progress, and output includes notifications to the emergency contact. The server uses a notification system such as Firebase Cloud Messaging to notify the designated contact of the progress.

[0946] Step 6:

[0947] If a user significantly exceeds the scheduled course time, the server will automatically send an emergency alert. Input data includes the user's current location and calculated progress, and output includes an emergency notification to emergency contacts. This allows registered emergency contacts to be alerted immediately and promptly respond.

[0948] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0949] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. Specific program processing of this system is described below.

[0950] 1. User registration and initial settings

[0951] Users install the app and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond to emergencies. Users can also set emergency contacts (family or acquaintances) to ensure quick contact in case of emergency.

[0952] 2. Route selection and information provision

[0953] The user selects a mountain climbing route appropriate for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides the user's app with appropriate route information (route map, necessary items, rest points, information on tent sites and mountain huts, etc.).

[0954] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[0955] 3. Start of climbing and measuring course time

[0956] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts recording the climb and enables the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[0957] 4. Sharing progress and emergency response

[0958] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[0959] 5. Incorporating an Emotional Engine

[0960] The emotion engine is installed in the smartphone and recognizes the user's emotions. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[0961] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[0962] 6. Emotion data contact sharing

[0963] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[0964] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[0965] 7. Comprehensive Safety Assessment and Emergency Measures

[0966] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[0967] Example: If the server determines, based on the user's emotional and progress data, that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[0968] In this way, by incorporating an emotion engine, climbers' safety can be managed more meticulously, allowing them to enjoy mountain climbing with peace of mind. Furthermore, we have built a system that can respond quickly in the unlikely event of an emergency.

[0969] The processing flow will be explained below.

[0970] Step 1:

[0971] A user installs the app, creates an account, and enters personal information (such as name, contact details, and experience level) to set up the account.

[0972] Step 2:

[0973] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[0974] Step 3:

[0975] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[0976] Step 4:

[0977] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[0978] Step 5:

[0979] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[0980] Step 6:

[0981] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[0982] Step 7:

[0983] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[0984] Step 8:

[0985] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[0986] Step 9:

[0987] The smartphone device manages the user's actions, measures the course time, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[0988] Step 10:

[0989] The emotion engine installed in the smartphone recognizes the user's emotions and analyzes data such as the user's facial expressions, voice, and heart rate to determine the user's current emotional state.

[0990] Step 11:

[0991] The smartphone device transmits the emotional state recognized by the emotion engine to the server, which allows the server to grasp the user's emotional state.

[0992] Step 12:

[0993] The server shares the emotional information recognized by the emotion engine with designated contacts in real time, allowing emergency contacts to check the user's emotional state.

[0994] Step 13:

[0995] The server integrates the emotional data and location information to make a comprehensive safety assessment, and takes emergency measures if it determines that the user is in danger.

[0996] Step 14:

[0997] In the event of an accident or if the user is in an extremely unstable emotional state, the server automatically sends a notification to emergency contacts and prepares to dispatch a rescue team if necessary.

[0998] In this way, by incorporating an emotion engine, the system can grasp the emotional state of climbers in real time, provide appropriate support and emergency measures, and provide a safer climbing experience.

[0999] Example 2

[1000] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1001] To effectively manage the safety of climbers, it is important to provide appropriate route information according to their experience level and to grasp their location information in real time. Furthermore, to respond quickly to emergencies, it is necessary to share the user's location and progress with relevant parties. Furthermore, it is also necessary to continuously monitor the user's emotional state while climbing and detect abnormalities early. However, there has been no previous system that provides comprehensive support and manages all of these in a unified manner.

[1002] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for providing appropriate route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's location information and emotional information with designated contacts in real time, means for using an emotion engine to analyze the user's emotional state, and means for performing a comprehensive safety assessment based on the user's location information and emotional information and taking emergency measures. This enables advanced management of climber safety and rapid response in emergencies.

[1003] A "user" is an individual who uses this system to go mountain climbing.

[1004] "Experience level" is an index that indicates the user's mountain climbing experience, and includes levels such as beginner, intermediate, and advanced.

[1005] "Route information" refers to detailed information about mountain climbing routes, including route maps, necessary items to bring, rest points, and information on tent sites and mountain huts.

[1006] "Current location" is location information of the location where the user is currently located, and is obtained using GPS.

[1007] "Progress status" refers to a state that includes information such as where the user is on the mountain climbing route and progress over time.

[1008] "Real-time" refers to the fact that data is sent and received almost instantaneously, meaning that the latest information is updated without delay.

[1009] "Contacts" refers to information about individuals or organizations that a user has registered to be contacted in an emergency.

[1010] An "emotion engine" is software or hardware that analyzes a user's emotional state, using data such as facial expressions, voice, and heart rate.

[1011] "Emotion information" is data that indicates the user's current emotional state as a result of analysis by the emotion engine.

[1012] "Safety assessment" is a process of assessing the safety of a user while climbing a mountain based on the user's location information and emotional information.

[1013] "Emergency measures" are measures that are taken immediately when it is determined that the user is in danger, and include notifying contacts and dispatching a rescue team.

[1014] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. A specific embodiment of this system will be described below.

[1015] User registration and initial settings

[1016] First, users install the app on their smartphone. After launching the app, they enter their personal information and climbing experience level. This information is later used to suggest suitable climbing routes and respond to emergencies. Users also set up emergency contacts (family or acquaintances) so they can be contacted immediately if necessary.

[1017] Route selection and information provision

[1018] When a user opens the "Route Selection" menu in the app, the server filters suitable climbing routes based on the user's experience level and current location. When the user selects one of the suggested routes, the server provides detailed information about that route (route map, necessary items, rest points, information on tent sites and mountain huts, etc.) to the user's smartphone.

[1019] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1," including a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest stops.

[1020] Start of climbing and course time measurement

[1021] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts the climb recording and activates the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[1022] Sharing progress and responding to emergencies

[1023] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[1024] Incorporating an emotion engine

[1025] The emotion engine is installed in the smartphone and recognizes the user's emotional state. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[1026] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[1027] Emotion data contact sharing

[1028] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[1029] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[1030] Comprehensive safety assessment and emergency measures

[1031] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[1032] Example: If the server determines based on the user's emotional and progress data that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[1033] Example prompt

[1034] The prompt sentences to input to the generative AI model are shown below.

[1035] Please explain the program processing for the following system in natural language. Please write so that the subject is either the server, the terminal, or the user. Please write sentence endings in the plain style.

[1036] (System) The system of this invention provides climbers with a safe and effective mountain climbing experience through collaboration between users, servers, smartphone devices, and an emotion engine.

[1037] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1038] Step 1: User registration and initial setup

[1039] The user installs the app on their smartphone. After installation is complete, the user launches the app and enters personal information such as name, age, gender, and emergency contact information, as well as their climbing experience level. This information is sent to a server and used to suggest appropriate climbing routes and respond in emergencies.

[1040] Input: Personal information (name, age, gender, emergency contact information), climbing experience level

[1041] Output: User information stored on the server

[1042] Specific operation: When the user enters information and presses the submit button, the server saves the information in a database.

[1043] Step 2: Route selection and information provision

[1044] The user opens the "Route Selection" menu in the app and selects a climbing route. The server filters and suggests suitable climbing routes based on the user's experience level and current location. Once the user selects a route, the server generates detailed route information and sends it to the smartphone device.

[1045] Input: current location, experience level

[1046] Output: Appropriate hiking route information (route map, packing list, rest points, etc.)

[1047] Specific operation: The server extracts the appropriate route from the database, generates detailed information and sends it to the user.

[1048] Step 3: Start climbing and measure course time

[1049] On the day of the climb, the user presses the "Start Climbing" button on the app. The smartphone activates GPS and acquires the user's current location in real time. The acquired location information is sent to a server and used to track progress.

[1050] Input: GPS data (current location)

[1051] Output: Real-time location data

[1052] Specific operation: The smartphone device periodically measures its current location and sends that data to the server.

[1053] Step 4: Sharing progress and emergency response

[1054] The server periodically acquires the user's location information and shares it with emergency contacts in real time. If an abnormality is detected in the user's progress, an alert will be sent to the emergency contacts.

[1055] Input: User's location

[1056] Output: Location sharing data to emergency contacts, alerts

[1057] Specific operation: The server analyzes the location information and notifies emergency contacts if there is an abnormality.

[1058] Step 5: Incorporating the Emotion Engine

[1059] The smartphone device is equipped with an emotion engine that analyzes the user's emotional state based on facial expressions, voice, heart rate, etc. The emotion engine sends the results to a server, which uses them for safety management.

[1060] Input: facial expression data, voice data, heart rate data

[1061] Output: Emotional state data

[1062] Specific operation: The smartphone device's sensors collect data, the emotion engine analyzes it, and sends the results to the server.

[1063] Step 6: Share emotion data with contacts

[1064] The server shares the user's emotional information recognized by the emotion engine with emergency contacts in real time. Designated family members and acquaintances can check the user's emotional state and take prompt action if necessary.

[1065] Input: Emotional state data

[1066] Output: Shared emotional state information

[1067] Specific operation: The server extracts the emotion data and sends it to the emergency contact.

[1068] Step 7: Comprehensive safety assessment and emergency measures

[1069] The server integrates the user's location and emotional data to provide a comprehensive safety assessment. If the server determines that the user is in danger, it immediately takes emergency measures, contacting emergency contacts and dispatching rescue teams if necessary.

[1070] Input: location data, emotional state data

[1071] Output: Safety assessment results, emergency measures

[1072] Specific operation: The server analyzes the data and immediately initiates emergency response procedures if a danger is detected.

[1073] Through the above steps, the system of the present invention can manage the safety of climbers in a sophisticated manner and can respond quickly in the event of an emergency.

[1074] (Application example 2)

[1075] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1076] Conventional systems lack the ability to appropriately recognize the emotional state of factory workers and dynamically adjust robot work instructions based on that state. As a result, when workers feel stressed or fatigued, not only does it become difficult to work efficiently, but safety also decreases. The present invention aims to solve these problems by providing a system that recognizes the emotional state of workers and adjusts work based on that state.

[1077] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1078] In this invention, the server includes means for providing appropriate work route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's work location information with designated contacts in real time, emotion processing means for recognizing and analyzing the user's emotional state, and control means for changing work instructions according to the emotional state, thereby enabling dynamic work adjustments in line with the worker's emotional state, improving safety and efficiency.

[1079] The "user experience level" is an index that indicates the worker's past work experience and skill level.

[1080] "Work route information" is information about a series of procedures and routes for workers to carry out work efficiently and safely.

[1081] "Current location" is information that indicates the exact location where the worker is currently located within the factory.

[1082] "Progress" is information that indicates the state and progress of the work process that the worker is currently in progress.

[1083] "Work location information" is information about the location where a worker is working within a factory.

[1084] "Designated Contacts" are people or departments designated to receive notification in the event of an emergency or other need.

[1085] "Emotional state" refers to the worker's current psychological state, and includes stress, fatigue, joy, etc.

[1086] "Emotion processing means" refers to techniques and methods for analyzing data such as a worker's facial expression, voice, and heart rate to recognize their emotional state.

[1087] "Control means" refers to techniques and methods for dynamically adjusting work instructions and robot behavior based on the acquired emotional state.

[1088] The system for realizing this invention mainly consists of three elements: a server, a terminal, and a user. Specifically, it provides appropriate work route information based on the user's experience level, acquires the user's current location, and tracks the user's progress in real time. It also includes a control system that recognizes the user's emotional state and dynamically changes work instructions based on that state.

[1089] Explanation of program processing

[1090] Hardware and Software Use

[1091] The hardware of the entire system includes a smartphone and head-mounted display (HMD) worn by the user, communication modules (Wi-Fi, Bluetooth, etc.) placed in the work environment, and sensors for measuring emotions (heart rate monitor, microphone, camera).The factory robot is managed using ROS (Robot Operating System).

[1092] Data processing and calculation

[1093] The server generates appropriate work route information based on the user's experience level and sends it to the device. The user's progress is captured in real time using GPS and internal sensors, and the results are periodically sent to the server. The server also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, etc. to identify and record their emotional state. Based on the emotional state, the server sends appropriate instructions to the factory robot and dynamically adjusts the robot's operation.

[1094] Use case details

[1095] Specific use cases include the following: If the emotion engine recognizes a user's stress level from their facial expressions or voice, the server immediately acquires the data and adjusts the working robot's movement speed to a slower speed. Also, if the user's heart rate is abnormally high, the server sends an instruction to the robot to temporarily halt its work and immediately notifies the supervisor or manager.

[1096] Prompt Sentence Examples

[1097] An example of a prompt using a generative AI model is, "Please create a program that uses EmotionEngine to recognize the worker's emotional state in real time, and suspends the work if the emotional state is 'stressed' or 'anxious'."

[1098] As a result, the system based on this invention is capable of dynamically adjusting work in accordance with the emotional state of the worker, and is expected to improve safety and efficiency.

[1099] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1100] Step 1:

[1101] The user inputs personal information and work experience level using a smartphone or head-mounted display (HMD).

[1102] (Input) User's personal information, work experience level

[1103] (Data processing / data calculation) The entered information is sent to the server and stored in the database.

[1104] (Output) Based on the saved information, the appropriate work route information is ready to be generated.

[1105] Specifically, when a user enters information into an input form and presses the send button, the data is sent to the server.

[1106] Step 2:

[1107] The server generates appropriate work route information based on the user's experience level and transmits it to the terminal.

[1108] (Input) User experience level

[1109] (Data processing and calculation) Based on experience level, it searches for the optimal work route and generates data along with detailed work instructions.

[1110] (Output) The generated work route information is sent to the user's terminal.

[1111] Specifically, the server refers to the database, searches for appropriate work route information, and sends it to the terminal.

[1112] Step 3:

[1113] The device will get your current location in real time and track your progress.

[1114] (Input) GPS data, sensor information

[1115] (Data processing and calculation) Obtain location information in real time, calculate progress and send it to the server.

[1116] (Output) Sends the current progress data to the server.

[1117] Specifically, the device periodically obtains location information from GPS and calculates progress.

[1118] Step 4:

[1119] The server shares the user's location and progress with emergency contacts in real time.

[1120] (Input) Location information, progress data

[1121] (Data processing and calculation) Location information and progress status are compiled and notified to designated emergency contacts.

[1122] (Output) Real-time notification to emergency contacts.

[1123] Specifically, the server periodically sends information to the emergency contact.

[1124] Step 5:

[1125] The emotion engine recognizes and analyzes the user's emotional state on the device.

[1126] (Input) Facial expression data, voice data, heart rate data

[1127] (Data processing and calculation) Analyze facial expressions, voice, and heart rate data to classify emotional states.

[1128] (Output) Send the analyzed emotional state data to the server.

[1129] Specifically, the device collects data using the camera, microphone, and sensors, and the emotion engine analyzes it.

[1130] Step 6:

[1131] The server changes the work instructions of the factory robot depending on the emotional state.

[1132] (Input) Emotional state data

[1133] (Data processing / data calculation) Based on emotional state data, instructions are generated to change the robot's operating parameters.

[1134] (Output) Instructions for the robot

[1135] Specifically, the server sends new motion instructions to the robot's control system, and the robot adjusts its motion according to those instructions.

[1136] The above are the specific processing steps in this system, which enables dynamic work adjustments in line with the emotional state of the worker.

[1137] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1138] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1139] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1140] [Fourth embodiment]

[1141] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1142] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1143] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1144] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1145] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1146] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1147] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1148] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1149] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1150] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1151] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1152] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1153] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1154] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone devices. Specific program processing of this system is described below.

[1155] 1. User registration and initial settings

[1156] Users install the app and enter their personal information and climbing experience level, which is then used to suggest suitable climbing routes and respond in emergencies.

[1157] 2. Route selection and information provision

[1158] The user selects a climbing route suitable for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.).

[1159] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[1160] 3. Start of climbing and measuring course time

[1161] On the day of the climb, when the user presses the "Start Climbing" button on the app, the smartphone activates the GPS and tracks the user's current location in real time. The device then sends the user's progress to the server and measures the course time.

[1162] Example: When a user presses the "Start climbing" button at the start of a mountain climb, the smartphone device acquires location information and determines the user's current location in real time. It also calculates the difference between the planned course time and actual progress, and notifies the user of delays and progress.

[1163] 4. Sharing progress and emergency response

[1164] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[1165] Example: The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[1166] This allows climbers to enjoy climbing with peace of mind and enables immediate response in the event of an emergency. Furthermore, by providing information on each step and tracking their location in real time, the system provides a safer climbing experience. This system is especially beneficial for beginners and inexperienced climbers, encouraging them to climb without straining themselves.

[1167] The processing flow will be explained below.

[1168] Step 1:

[1169] A user installs the app and creates an account. The user enters personal information (such as name, contact details, and experience level) and sets up the account.

[1170] Step 2:

[1171] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[1172] Step 3:

[1173] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[1174] Step 4:

[1175] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[1176] Step 5:

[1177] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[1178] Step 6:

[1179] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[1180] Step 7:

[1181] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[1182] Step 8:

[1183] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[1184] Step 9:

[1185] The smartphone device measures the user's course time, evaluates their progress, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[1186] Step 10:

[1187] In the unlikely event of an accident, the server will automatically send the user's location information and emergency alert to emergency contacts, enabling a rapid response.

[1188] In this way, through the processing of each step, climbers can enjoy climbing safely and a system is provided that allows for quick response in the event of an emergency.

[1189] Example 1

[1190] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1191] Current mountain climbing support systems have difficulty selecting the optimal route based on the user's climbing experience and skills, and do not adequately track the user's location and share their progress in real time during the climb, which can delay emergency response.In addition, there is no appropriate notification system in place that reflects the user's progress, making it difficult to fully ensure the safety of climbers.

[1192] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1193] In this invention, the server includes means for inputting and saving the user's personal information and climbing experience level, and selecting and providing a route based on that information; means for acquiring the user's current location and tracking progress in real time; means for sharing the user's climbing location information with designated contacts in real time; and means for calculating the difference between the planned course time and actual progress based on the user's progress and notifying the user of the difference. This allows the server to provide the optimal climbing route based on the user's experience, and real-time location tracking and progress sharing enable rapid response in emergencies. Furthermore, appropriate notifications based on progress can increase the safety of climbers.

[1194] "User" refers to an individual who uses the mountain climbing support system.

[1195] "Experience level" refers to a standard for classifying a user's mountaineering experience and skill level.

[1196] "Mountain climbing route information" refers to the route and related information when a user goes mountain climbing (route map, list of items to bring, rest points, information on tent sites and mountain huts, etc.).

[1197] "Current location" refers to geographical information that indicates where the user is in real time while climbing a mountain.

[1198] "Progress" refers to the state that indicates how much progress the user has made while climbing.

[1199] "Real-time" refers to the fact that the user's current location and progress are known immediately and without delay.

[1200] "Designated Contact" refers to a person or organization registered with whom you share your location information in case of an emergency, etc.

[1201] "Personal information" refers to information that identifies an individual user, such as the user's name and contact information.

[1202] "Server" refers to a computer system that processes and stores data from users and provides necessary information.

[1203] "GPS" stands for Global Positioning System, a satellite navigation system for determining location on Earth.

[1204] "Discrepancy" refers to the difference in time or distance between the scheduled course time and the user's actual progress.

[1205] "Notification" refers to a message or alert that the system uses to immediately inform the user of important information.

[1206] "Course time" refers to the estimated time that indicates how long it will take the user to complete each section of the mountain climb.

[1207] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, a server, and smartphone terminals. Specific program processing of this system is described below.

[1208] User registration and initial settings

[1209] Users install a mountaineering support app on their smartphone and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond in emergencies. The device sends this data to a server, which stores it in a database.

[1210] Specific examples

[1211] The user installs the app and enters their name, phone number, and the fact that they are a beginner climber. The device sends this information to the server, which then stores it.

[1212] Route selection and information provision

[1213] The user selects a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app. Based on this selection, the server sends the necessary route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) to the device.

[1214] Specific examples

[1215] When a beginner user selects a "Level 1" route in the app, the server displays a detailed map from the entry point to the finish line, a list of items to bring, and appropriate rest stops on the device.

[1216] Start of climbing and course time measurement

[1217] When the user starts climbing, they press the "Start Climbing" button on the app. This activates the device's GPS and tracks the user's current location in real time. The device periodically sends the user's progress to the server, which uses this information to measure the course time. The device also notifies the user if their progress is slow or too fast.

[1218] Specific examples

[1219] When the user presses the "Start Climbing" button to begin climbing, the device acquires location information and grasps the user's location in real time. It calculates the difference between the planned course time and the actual progress and sends a notification of this to the device.

[1220] Sharing progress and responding to emergencies

[1221] The server periodically shares the user's location information with emergency contacts, enabling a rapid response in the unlikely event of an accident. Emergency contacts can check the user's location and progress in real time via a webpage or dedicated app. If the user significantly exceeds the scheduled course time, an automatic alert is sent, urging a rapid response.

[1222] Specific examples

[1223] The user's location information is updated regularly and notified to the smartphones of registered family members. Family members can check the user's location and progress in real time via a dedicated webpage or app. If the user significantly exceeds the scheduled course time, an alert is automatically sent to emergency contacts, urging them to take prompt action.

[1224] Prompt Sentence Examples

[1225] Examples of prompts to input to a generative AI model include:

[1226] "Please explain how a system that provides a safe mountain climbing experience for beginner climbers works. The system begins by the user registering their personal information and climbing experience level on their smartphone and selecting an appropriate climbing route. Once the climb begins, the system uses GPS to track the user's location in real time, sending their progress to a server and sharing their location with emergency contacts. It is designed to ensure a rapid response in the event of an emergency."

[1227] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1228] Step 1:

[1229] The user installs a mountain climbing support app on their smartphone and enters their personal information and mountain climbing experience level.

[1230] Input: User's name, contact information, and climbing experience level.

[1231] Data processing and output: The terminal processes the input data and sends it to the server, which receives it and stores it in a database.

[1232] Specific actions

[1233] 1. A user downloads an app from the App Store or Google Play.

[1234] 2. The user launches the app and enters their name, contact information, and climbing experience.

[1235] 3. The device sends this data to the server, which receives it and stores it in a database.

[1236] Step 2:

[1237] Users select a climbing route suitable for their climbing experience level from the "Route Selection" menu within the app.

[1238] Input: The user's climbing experience level.

[1239] Data processing and output: The server selects an appropriate climbing route based on the user's experience level, generates route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.), and sends it to the device.

[1240] Specific actions

[1241] 1. The user opens the "Route Selection" menu.

[1242] 2. The user selects a route appropriate for their experience level, e.g. "Level 1".

[1243] 3. The server generates route information based on the selected route and sends it to the terminal.

[1244] 4. The device displays the route information to the user.

[1245] Step 3:

[1246] When the user starts climbing, they press the "Start Climbing" button on the app.

[1247] Input: Press the Start Climbing button.

[1248] Data processing and output: The device activates the GPS, acquires the user's current location, and sends it to the server. The server receives this information and starts measuring the course time.

[1249] Specific actions

[1250] 1. The user presses the "Start climbing" button in the app.

[1251] 2. The device activates the GPS and acquires location information.

[1252] 3. The device periodically sends location information to the server.

[1253] 4. The server receives the location information and measures the course time.

[1254] Step 4:

[1255] The server checks the user's progress and calculates the difference between the planned course time and the actual progress.

[1256] Input: User's real-time location data.

[1257] Data processing and output: The server compares the time with the planned course time, calculates the discrepancy, and notifies the terminal of the result.

[1258] Specific actions

[1259] 1. The server receives location information sent at regular intervals.

[1260] 2. The server calculates the difference between the scheduled course time and the actual progress.

[1261] 3. The server notifies the device of the deviation result.

[1262] Step 5:

[1263] The server periodically shares the user's location information with emergency contacts.

[1264] Input: User's location, emergency contact information.

[1265] Data processing and output: The server sends location information to emergency contacts and generates alerts as needed.

[1266] Specific actions

[1267] 1. The server periodically updates the user's location.

[1268] 2. The server sends the location information to the emergency contact.

[1269] 3. The emergency contact user checks the user's location through a dedicated web page or app.

[1270] 4. The server automatically sends an alert if the user significantly exceeds the scheduled course time.

[1271] (Application example 1)

[1272] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1273] In today's mountaineering environment, ensuring climber safety and responding quickly in emergencies are essential, but there are limited systems that can effectively achieve this. Furthermore, there is a lack of appropriate route suggestions and progress management for beginners and inexperienced climbers, increasing the risk of accidents during mountaineering. To solve these problems, a system with real-time location tracking and automatic notification to emergency contacts is needed.

[1274] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1275] In this invention, the server includes a means for providing appropriate mountain climbing route information based on the user's experience level, a means for acquiring the user's current location and tracking the user's progress in real time, a means for sharing the user's mountain climbing location information with designated contacts in real time, and a means for automatically issuing alerts in the event of an emergency. This ensures the safety of the climber, enables rapid emergency response, and enables a natural mountain climbing activity through route suggestions.

[1276] A "user" is an individual climber who uses the system, inputs the necessary information, and enjoys a safe climbing experience.

[1277] "Mountain climbing route information" refers to information such as guidelines, a list of items to bring, and rest points necessary for mountain climbing, which are provided based on the user's experience level and selection.

[1278] "Current location" refers to the climber's real-time geographic location, obtained using technology such as GPS.

[1279] "Progress" refers to information such as where a climber is along the climbing route, the difference between planned and actual progress, and so on.

[1280] "Designated Contacts" are the climber's registered emergency contacts, which may include family, friends, or rescue agencies.

[1281] "Means for automatically sending alerts in emergencies" is a function that automatically sends a warning to registered emergency contacts when a situation that threatens the safety of climbers is detected.

[1282] "Behavior management" is the process of tracking a user's progress and behavior and ensuring adherence to planned schedules and routes.

[1283] "Course time" refers to the estimated or actual time required to reach the destination from the starting point of a climb.

[1284] A "server" is a central processing unit that provides information, tracks locations, manages progress, etc. based on requests from users.

[1285] To implement the present invention, a system program is required that performs the following steps in order.

[1286] Program processing overview

[1287] User registration and initial settings

[1288] After installing the smartphone app, users input their personal information and climbing experience level, which is then sent to the server, where appropriate initial settings are made.

[1289] Route selection and information provision

[1290] The server provides climbing route information based on the user's experience level. Specifically, the server selects an appropriate route from a pre-prepared route database and sends it to the user's smartphone along with a list of items to bring, information on rest points, tent sites, and mountain huts.

[1291] Start climbing and track location

[1292] When a user presses the "Start Climbing" button, the smartphone's GPS function is activated and the current location is sent to the server in real time. The server analyzes the progress and shares the user's location information with designated contacts.

[1293] Emergency response

[1294] The server periodically manages the user's progress and location information, and has a means to automatically send alerts in the event of an emergency, so that designated contacts are promptly notified of the emergency situation.

[1295] Hardware and software used

[1296] Hardware

[1297] Smartphones: Equipped with a built-in GPS module for obtaining location information (e.g., iPhone, Android devices).

[1298] Smart glasses: Provide visual information needed while climbing (e.g. Google Glass).

[1299] Head-mounted displays: Showing real-time maps and route information (e.g., HoloLens).

[1300] software

[1301] Server: A central management system that provides information, location tracking, and emergency notifications (e.g., AWS, Google Cloud Platform).

[1302] Mobile app development platform: Used to develop applications (e.g., React Native, Flutter).

[1303] Notification system: Provides periodic updates and alerts (e.g., Firebase Cloud Messaging).

[1304] Examples

[1305] For example, when a beginner climber climbs a mountain for the first time, they use the app to select a route and begin climbing based on the route information provided by the server. As they climb, their smartphone tracks the user's location in real time and periodically sends the location information to the server. The server analyzes this information and notifies the user's family of their progress in real time. In the unlikely event of an accident or overrun, an emergency alert is automatically sent to the family's smartphone.

[1306] Prompt Sentence Examples

[1307] "The following application will have real-time tracking and emergency alert functions to ensure the safety of climbers. Specific functions include user registration, climbing route selection, GPS tracking, and real-time location sharing. Please provide the program code to implement this."

[1308] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1309] Step 1:

[1310] A user installs the app on their smartphone and enters their personal information and climbing experience level. This information is sent from the device to the server. The input data includes the user's name, contact information, and past climbing experience (beginner, intermediate, advanced). The server receives this data and generates a user profile.

[1311] Step 2:

[1312] The user selects a mountain climbing route suitable for their experience level from the "Route Selection" menu within the app. The server generates appropriate route information (route map, packing list, rest points, information on tent sites and mountain huts, etc.) based on the selected experience level. The user's experience level and selected route are provided to the server as input, and the server retrieves the relevant route information from its internal database and sends it to the device.

[1313] Step 3:

[1314] When a user presses the "Start Mountain Climbing" button on their smartphone, the device activates its GPS function and acquires their current location. GPS data (latitude, longitude, altitude, etc.) is sent to the server in real time. The server receives input data, including location information from the GPS, and tracks the user's progress.

[1315] Step 4:

[1316] The server analyzes the user's progress based on the received current location data. The server compares the user's progress against the scheduled course time and evaluates progress and delays. Input data includes GPS location information and the pre-set course time, and output data includes progress and delays sent to the device.

[1317] Step 5:

[1318] The server periodically sends the user's progress and location to a designated emergency contact. Input data includes the current location and progress, and output includes notifications to the emergency contact. The server uses a notification system such as Firebase Cloud Messaging to notify the designated contact of the progress.

[1319] Step 6:

[1320] If a user significantly exceeds the scheduled course time, the server will automatically send an emergency alert. Input data includes the user's current location and calculated progress, and output includes an emergency notification to emergency contacts. This allows registered emergency contacts to be alerted immediately and promptly respond.

[1321] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1322] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. Specific program processing of this system is described below.

[1323] 1. User registration and initial settings

[1324] Users install the app and enter their personal information and climbing experience level. This information is used to suggest appropriate climbing routes and respond to emergencies. Users can also set emergency contacts (family or acquaintances) to ensure quick contact in case of emergency.

[1325] 2. Route selection and information provision

[1326] The user selects a mountain climbing route appropriate for their experience level from the "Route Selection" menu within the app. Based on this selection, the server provides the user's app with appropriate route information (route map, necessary items, rest points, information on tent sites and mountain huts, etc.).

[1327] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1." This information includes a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest points.

[1328] 3. Start of climbing and measuring course time

[1329] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts recording the climb and enables the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[1330] 4. Sharing progress and emergency response

[1331] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[1332] 5. Incorporating an Emotional Engine

[1333] The emotion engine is installed in the smartphone and recognizes the user's emotions. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[1334] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[1335] 6. Emotion data contact sharing

[1336] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[1337] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[1338] 7. Comprehensive Safety Assessment and Emergency Measures

[1339] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[1340] Example: If the server determines, based on the user's emotional and progress data, that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[1341] In this way, by incorporating an emotion engine, climbers' safety can be managed more meticulously, allowing them to enjoy mountain climbing with peace of mind. Furthermore, we have built a system that can respond quickly in the unlikely event of an emergency.

[1342] The processing flow will be explained below.

[1343] Step 1:

[1344] A user installs the app, creates an account, and enters personal information (such as name, contact details, and experience level) to set up the account.

[1345] Step 2:

[1346] The user sets up emergency contacts (family and friends), who will receive location information during mountain climbing and emergency notifications.

[1347] Step 3:

[1348] The user selects a climbing route according to their experience level in the "Route Selection" menu within the app. Once the user confirms their selection, a request is sent to the server.

[1349] Step 4:

[1350] Based on the route selected by the user, the server obtains appropriate route information (route map, necessary items to bring, rest points, information on tent sites and mountain huts, etc.) and provides it to the user's app.

[1351] Step 5:

[1352] On the day of the climb, the user presses the "Start Climbing" button in the app, which starts recording the climb and enables the GPS.

[1353] Step 6:

[1354] The smartphone uses GPS to obtain the user's current location in real time, which is necessary to track the user's progress.

[1355] Step 7:

[1356] The smartphone periodically sends the user's current location to the server, allowing the server to monitor the user's progress in real time.

[1357] Step 8:

[1358] The server shares the user's location information with designated contacts (emergency contacts) in real time, allowing family and friends to check the user's location.

[1359] Step 9:

[1360] The smartphone device manages the user's actions, measures the course time, calculates the difference between the planned course time and the actual elapsed time, and notifies the user.

[1361] Step 10:

[1362] The emotion engine installed in the smartphone recognizes the user's emotions and analyzes data such as the user's facial expressions, voice, and heart rate to determine the user's current emotional state.

[1363] Step 11:

[1364] The smartphone device transmits the emotional state recognized by the emotion engine to the server, which allows the server to grasp the user's emotional state.

[1365] Step 12:

[1366] The server shares the emotional information recognized by the emotion engine with designated contacts in real time, allowing emergency contacts to check the user's emotional state.

[1367] Step 13:

[1368] The server integrates the emotional data and location information to make a comprehensive safety assessment, and takes emergency measures if it determines that the user is in danger.

[1369] Step 14:

[1370] In the event of an accident or if the user is in an extremely unstable emotional state, the server automatically sends a notification to emergency contacts and prepares to dispatch a rescue team if necessary.

[1371] In this way, by incorporating an emotion engine, the system can grasp the emotional state of climbers in real time, provide appropriate support and emergency measures, and provide a safer climbing experience.

[1372] Example 2

[1373] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1374] To effectively manage the safety of climbers, it is important to provide appropriate route information according to their experience level and to grasp their location information in real time. Furthermore, to respond quickly to emergencies, it is necessary to share the user's location and progress with relevant parties. Furthermore, it is also necessary to continuously monitor the user's emotional state while climbing and detect abnormalities early. However, there has been no previous system that provides comprehensive support and manages all of these in a unified manner.

[1375] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for providing appropriate route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's location information and emotional information with designated contacts in real time, means for using an emotion engine to analyze the user's emotional state, and means for performing a comprehensive safety assessment based on the user's location information and emotional information and taking emergency measures. This enables advanced management of climber safety and rapid response in emergencies.

[1376] A "user" is an individual who uses this system to go mountain climbing.

[1377] "Experience level" is an index that indicates the user's mountain climbing experience, and includes levels such as beginner, intermediate, and advanced.

[1378] "Route information" refers to detailed information about mountain climbing routes, including route maps, necessary items to bring, rest points, and information on tent sites and mountain huts.

[1379] "Current location" is location information of the location where the user is currently located, and is obtained using GPS.

[1380] "Progress status" refers to a state that includes information such as where the user is on the mountain climbing route and progress over time.

[1381] "Real-time" refers to the fact that data is sent and received almost instantaneously, meaning that the latest information is updated without delay.

[1382] "Contacts" refers to information about individuals or organizations that a user has registered to be contacted in an emergency.

[1383] An "emotion engine" is software or hardware that analyzes a user's emotional state, using data such as facial expressions, voice, and heart rate.

[1384] "Emotion information" is data that indicates the user's current emotional state as a result of analysis by the emotion engine.

[1385] "Safety assessment" is a process of assessing the safety of a user while climbing a mountain based on the user's location information and emotional information.

[1386] "Emergency measures" are measures that are taken immediately when it is determined that the user is in danger, and include notifying contacts and dispatching a rescue team.

[1387] The system of the present invention provides climbers with a safe and effective mountain climbing experience through cooperation between users, servers, smartphone terminals, and an emotion engine. A specific embodiment of this system will be described below.

[1388] User registration and initial settings

[1389] First, users install the app on their smartphone. After launching the app, they enter their personal information and climbing experience level. This information is later used to suggest suitable climbing routes and respond to emergencies. Users also set up emergency contacts (family or acquaintances) so they can be contacted immediately if necessary.

[1390] Route selection and information provision

[1391] When a user opens the "Route Selection" menu in the app, the server filters suitable climbing routes based on the user's experience level and current location. When the user selects one of the suggested routes, the server provides detailed information about that route (route map, necessary items, rest points, information on tent sites and mountain huts, etc.) to the user's smartphone.

[1392] Example: When a beginner user selects a "Level 1" route, the server provides route information suitable for "Level 1," including a detailed map from the entry point to the goal, a list of necessary items to bring, and appropriate rest stops.

[1393] Start of climbing and course time measurement

[1394] On the day of the climb, the user presses the "Start Climbing" button in the app. This action starts the climb recording and activates the GPS. The smartphone uses GPS to obtain the user's current location in real time, and this location information is necessary to track the user's progress.

[1395] Sharing progress and responding to emergencies

[1396] The server periodically shares the user's location information with designated emergency contacts in real time, enabling a rapid response in the event of an accident.

[1397] Incorporating an emotion engine

[1398] The emotion engine is installed in the smartphone and recognizes the user's emotional state. The emotion engine analyzes data such as the user's facial expressions, voice, and heart rate to identify their current emotional state. This information is used to enhance safety management during mountain climbing.

[1399] Example: When the emotion engine detects stress or anxiety from the user's voice or heart rate, the server immediately receives this information and sends appropriate alerts and support messages to the user based on the recognized emotion.

[1400] Emotion data contact sharing

[1401] The server shares the user's emotional information recognized by the emotion engine with emergency contacts, allowing designated family members or acquaintances to check the user's emotional state in real time and take prompt action if necessary.

[1402] Example: If the server detects a user's negative emotional state, it immediately sends a notification to emergency contacts, allowing family members to see what the user's emotional state is and get in touch if necessary.

[1403] Comprehensive safety assessment and emergency measures

[1404] The emotion engine combines the collected emotion data with the location information to generate a comprehensive safety assessment. The server analyzes this data and automatically takes emergency measures if it determines that the user is in danger.

[1405] Example: If the server determines based on the user's emotional and progress data that the user is in a state of extreme stress and is significantly behind schedule, it will immediately contact emergency contacts and prepare to dispatch a rescue team if necessary.

[1406] Example prompt

[1407] The prompt sentences to input to the generative AI model are shown below.

[1408] Please explain the program processing for the following system in natural language. Please write so that the subject is either the server, the terminal, or the user. Please write sentence endings in the plain style.

[1409] (System) The system of this invention provides climbers with a safe and effective mountain climbing experience through collaboration between users, servers, smartphone devices, and an emotion engine.

[1410] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1411] Step 1: User registration and initial setup

[1412] The user installs the app on their smartphone. After installation is complete, the user launches the app and enters personal information such as name, age, gender, and emergency contact information, as well as their climbing experience level. This information is sent to a server and used to suggest appropriate climbing routes and respond in emergencies.

[1413] Input: Personal information (name, age, gender, emergency contact information), climbing experience level

[1414] Output: User information stored on the server

[1415] Specific operation: When the user enters information and presses the submit button, the server saves the information in a database.

[1416] Step 2: Route selection and information provision

[1417] The user opens the "Route Selection" menu in the app and selects a climbing route. The server filters and suggests suitable climbing routes based on the user's experience level and current location. Once the user selects a route, the server generates detailed route information and sends it to the smartphone device.

[1418] Input: current location, experience level

[1419] Output: Appropriate hiking route information (route map, packing list, rest points, etc.)

[1420] Specific operation: The server extracts the appropriate route from the database, generates detailed information and sends it to the user.

[1421] Step 3: Start climbing and measure course time

[1422] On the day of the climb, the user presses the "Start Climbing" button on the app. The smartphone activates GPS and acquires the user's current location in real time. The acquired location information is sent to a server and used to track progress.

[1423] Input: GPS data (current location)

[1424] Output: Real-time location data

[1425] Specific operation: The smartphone device periodically measures its current location and sends that data to the server.

[1426] Step 4: Sharing progress and emergency response

[1427] The server periodically acquires the user's location information and shares it with emergency contacts in real time. If an abnormality is detected in the user's progress, an alert will be sent to the emergency contacts.

[1428] Input: User's location

[1429] Output: Location sharing data to emergency contacts, alerts

[1430] Specific operation: The server analyzes the location information and notifies emergency contacts if there is an abnormality.

[1431] Step 5: Incorporating the Emotion Engine

[1432] The smartphone device is equipped with an emotion engine that analyzes the user's emotional state based on facial expressions, voice, heart rate, etc. The emotion engine sends the results to a server, which uses them for safety management.

[1433] Input: facial expression data, voice data, heart rate data

[1434] Output: Emotional state data

[1435] Specific operation: The smartphone device's sensors collect data, the emotion engine analyzes it, and sends the results to the server.

[1436] Step 6: Share emotion data with contacts

[1437] The server shares the user's emotional information recognized by the emotion engine with emergency contacts in real time. Designated family members and acquaintances can check the user's emotional state and take prompt action if necessary.

[1438] Input: Emotional state data

[1439] Output: Shared emotional state information

[1440] Specific operation: The server extracts the emotion data and sends it to the emergency contact.

[1441] Step 7: Comprehensive safety assessment and emergency measures

[1442] The server integrates the user's location and emotional data to provide a comprehensive safety assessment. If the server determines that the user is in danger, it immediately takes emergency measures, contacting emergency contacts and dispatching rescue teams if necessary.

[1443] Input: location data, emotional state data

[1444] Output: Safety assessment results, emergency measures

[1445] Specific operation: The server analyzes the data and immediately initiates emergency response procedures if a danger is detected.

[1446] Through the above steps, the system of the present invention can manage the safety of climbers in a sophisticated manner and can respond quickly in the event of an emergency.

[1447] (Application example 2)

[1448] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1449] Conventional systems lack the ability to appropriately recognize the emotional state of factory workers and dynamically adjust robot work instructions based on that state. As a result, when workers feel stressed or fatigued, not only does it become difficult to work efficiently, but safety also decreases. The present invention aims to solve these problems by providing a system that recognizes the emotional state of workers and adjusts work based on that state.

[1450] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1451] In this invention, the server includes means for providing appropriate work route information based on the user's experience level, means for acquiring the user's current location and tracking the progress in real time, means for sharing the user's work location information with designated contacts in real time, emotion processing means for recognizing and analyzing the user's emotional state, and control means for changing work instructions according to the emotional state, thereby enabling dynamic work adjustments in line with the worker's emotional state, improving safety and efficiency.

[1452] The "user experience level" is an index that indicates the worker's past work experience and skill level.

[1453] "Work route information" is information about a series of procedures and routes for workers to carry out work efficiently and safely.

[1454] "Current location" is information that indicates the exact location where the worker is currently located within the factory.

[1455] "Progress" is information that indicates the state and progress of the work process that the worker is currently in progress.

[1456] "Work location information" is information about the location where a worker is working within a factory.

[1457] "Designated Contacts" are people or departments designated to receive notification in the event of an emergency or other need.

[1458] "Emotional state" refers to the worker's current psychological state, and includes stress, fatigue, joy, etc.

[1459] "Emotion processing means" refers to techniques and methods for analyzing data such as a worker's facial expression, voice, and heart rate to recognize their emotional state.

[1460] "Control means" refers to techniques and methods for dynamically adjusting work instructions and robot behavior based on the acquired emotional state.

[1461] The system for realizing this invention mainly consists of three elements: a server, a terminal, and a user. Specifically, it provides appropriate work route information based on the user's experience level, acquires the user's current location, and tracks the user's progress in real time. It also includes a control system that recognizes the user's emotional state and dynamically changes work instructions based on that state.

[1462] Explanation of program processing

[1463] Hardware and Software Use

[1464] The hardware of the entire system includes a smartphone and head-mounted display (HMD) worn by the user, communication modules (Wi-Fi, Bluetooth, etc.) placed in the work environment, and sensors for measuring emotions (heart rate monitor, microphone, camera).The factory robot is managed using ROS (Robot Operating System).

[1465] Data processing and calculation

[1466] The server generates appropriate work route information based on the user's experience level and sends it to the device. The user's progress is captured in real time using GPS and internal sensors, and the results are periodically sent to the server. The server also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, etc. to identify and record their emotional state. Based on the emotional state, the server sends appropriate instructions to the factory robot and dynamically adjusts the robot's operation.

[1467] Use case details

[1468] Specific use cases include the following: If the emotion engine recognizes a user's stress level from their facial expressions or voice, the server immediately acquires the data and adjusts the working robot's movement speed to a slower speed. Also, if the user's heart rate is abnormally high, the server sends an instruction to the robot to temporarily halt its work and immediately notifies the supervisor or manager.

[1469] Prompt Sentence Examples

[1470] An example of a prompt using a generative AI model is, "Please create a program that uses EmotionEngine to recognize the worker's emotional state in real time, and suspends the work if the emotional state is 'stressed' or 'anxious'."

[1471] As a result, the system based on this invention is capable of dynamically adjusting work in accordance with the emotional state of the worker, and is expected to improve safety and efficiency.

[1472] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1473] Step 1:

[1474] The user inputs personal information and work experience level using a smartphone or head-mounted display (HMD).

[1475] (Input) User's personal information, work experience level

[1476] (Data processing / data calculation) The entered information is sent to the server and stored in the database.

[1477] (Output) Based on the saved information, the appropriate work route information is ready to be generated.

[1478] Specifically, when a user enters information into an input form and presses the send button, the data is sent to the server.

[1479] Step 2:

[1480] The server generates appropriate work route information based on the user's experience level and transmits it to the terminal.

[1481] (Input) User experience level

[1482] (Data processing and calculation) Based on experience level, it searches for the optimal work route and generates data along with detailed work instructions.

[1483] (Output) The generated work route information is sent to the user's terminal.

[1484] Specifically, the server refers to the database, searches for appropriate work route information, and sends it to the terminal.

[1485] Step 3:

[1486] The device will get your current location in real time and track your progress.

[1487] (Input) GPS data, sensor information

[1488] (Data processing and calculation) Obtain location information in real time, calculate progress and send it to the server.

[1489] (Output) Sends the current progress data to the server.

[1490] Specifically, the device periodically obtains location information from GPS and calculates progress.

[1491] Step 4:

[1492] The server shares the user's location and progress with emergency contacts in real time.

[1493] (Input) Location information, progress data

[1494] (Data processing and calculation) Location information and progress status are compiled and notified to designated emergency contacts.

[1495] (Output) Real-time notification to emergency contacts.

[1496] Specifically, the server periodically sends information to the emergency contact.

[1497] Step 5:

[1498] The emotion engine recognizes and analyzes the user's emotional state on the device.

[1499] (Input) Facial expression data, voice data, heart rate data

[1500] (Data processing and calculation) Analyze facial expressions, voice, and heart rate data to classify emotional states.

[1501] (Output) Send the analyzed emotional state data to the server.

[1502] Specifically, the device collects data using the camera, microphone, and sensors, and the emotion engine analyzes it.

[1503] Step 6:

[1504] The server changes the work instructions of the factory robot depending on the emotional state.

[1505] (Input) Emotional state data

[1506] (Data processing / data calculation) Based on emotional state data, instructions are generated to change the robot's operating parameters.

[1507] (Output) Instructions for the robot

[1508] Specifically, the server sends new motion instructions to the robot's control system, and the robot adjusts its motion according to those instructions.

[1509] The above are the specific processing steps in this system, which enables dynamic work adjustments in line with the emotional state of the worker.

[1510] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1511] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1512] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1513] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1514] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1515] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1516] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1517] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1518] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1519] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1520] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1521] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1522] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1523] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1524] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1525] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1526] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1527] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1528] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1529] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1530] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1531] The following is further disclosed regarding the above embodiment.

[1532] (Claim 1)

[1533] means for providing appropriate climbing route information based on the user's experience level;

[1534] means for obtaining the user's current location and tracking their progress in real time;

[1535] a means for sharing the user's mountain climbing location information with designated contacts in real time;

[1536] A system including:

[1537] (Claim 2)

[1538] 2. The system according to claim 1, further comprising means for managing the user's behavior and measuring the course time.

[1539] (Claim 3)

[1540] 10. The system of claim 1, further comprising means for periodically transmitting the user's location information and progress to a server to enable emergency response if necessary.

[1541] "Example 1"

[1542] (Claim 1)

[1543] means for providing appropriate climbing route information based on the user's experience level;

[1544] means for obtaining the user's current location and tracking their progress in real time;

[1545] a means for sharing the user's mountain climbing location information with designated contacts in real time;

[1546] A means for inputting and storing the user's personal information and mountaineering experience level, and selecting and providing a route based on the information;

[1547] A means for calculating the difference between the planned course time and the actual progress of the user according to the progress of the user, and notifying the user of the difference;

[1548] A system including:

[1549] (Claim 2)

[1550] 2. The system according to claim 1, further comprising means for managing the user's behavior and measuring the course time.

[1551] (Claim 3)

[1552] 10. The system of claim 1, further comprising means for periodically transmitting the user's location information and progress to a server to enable emergency response if necessary.

[1553] "Application Example 1"

[1554] (Claim 1)

[1555] means for providing appropriate climbing route information based on the user's experience level;

[1556] means for obtaining the user's current location and tracking their progress in real time;

[1557] a means for sharing the user's mountain climbing location information with designated contacts in real time;

[1558] A means of automatically issuing alerts in the event of an emergency,

[1559] A system including:

[1560] (Claim 2)

[1561] 2. The system according to claim 1, further comprising means for managing the user's behavior and measuring the course time.

[1562] (Claim 3)

[1563] 10. The system of claim 1, further comprising means for periodically transmitting the user's location information and progress to a server to enable emergency response if necessary.

[1564] "Example 2: Combining Emotion Engines"

[1565] (Claim 1)

[1566] means for providing appropriate route information based on the user's experience level;

[1567] means for obtaining the user's current location and tracking their progress in real time;

[1568] means for sharing the user's location information with designated contacts in real time;

[1569] means using an emotion engine to analyze the user's emotional state;

[1570] means for sharing the user's emotional information with designated contacts in real time;

[1571] A means to conduct a comprehensive safety assessment based on the user's location and emotional information and take emergency measures;

[1572] A system including:

[1573] (Claim 2)

[1574] 2. The system according to claim 1, further comprising means for managing the user's behavior and measuring the course time.

[1575] (Claim 3)

[1576] 10. The system of claim 1, further comprising means for periodically transmitting the user's location information and progress to a server to enable emergency response if necessary.

[1577] "Application example 2 when combining emotion engines"

[1578] (Claim 1)

[1579] means for providing appropriate work route information based on the user's experience level;

[1580] means for obtaining the user's current location and tracking their progress in real time;

[1581] means for sharing the user's work location information with designated contacts in real time;

[1582] emotion processing means for recognizing and analyzing the user's emotional state;

[1583] a control means for changing work instructions in response to the emotional state;

[1584] A system including:

[1585] (Claim 2)

[1586] 2. The system according to claim 1, further comprising means for managing the user's behavior and measuring the course time.

[1587] (Claim 3)

[1588] 10. The system of claim 1, further comprising means for periodically transmitting the user's location information and progress to a server to enable emergency response if necessary. [Explanation of symbols]

[1589] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for providing appropriate climbing route information based on the user's experience level; means for obtaining the user's current location and tracking their progress in real time; a means for sharing the user's mountain climbing location information with designated contacts in real time; A system including:

2. The system according to claim 1, further comprising means for managing the user's behavior and measuring the course time.

3. 10. The system of claim 1, further comprising means for periodically transmitting the user's location information and progress to a server, enabling emergency response if necessary.

Images