Monitoring devices, programs, and servers
The monitored device optimizes communication by displaying situation-specific response candidates and adapting the interface to the user's circumstances, improving interaction efficiency and usability through AI-driven situational judgment.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- MIXI INC
- Filing Date
- 2025-05-13
- Publication Date
- 2026-07-01
AI Technical Summary
Existing monitoring devices lack the ability to support appropriate communication tailored to the diverse circumstances of the monitored person, such as children or the elderly, by providing response candidates that are not situation-specific and user-friendly.
A monitored device that displays prioritized response candidates based on situation information, including position, time, and activity information, with an input receiving unit for confirming selections and transmitting response information to a parent terminal, utilizing AI-driven situational judgment and dynamic interface optimization.
Enhances communication support by providing intuitive and error-free interaction, adapting to the monitored person's situation, reducing response time, and improving usability through AI-driven situational judgment and dynamic interface adjustments.
Smart Images

Figure 2026109489000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a monitored device, a program, and a server.
Background Art
[0002] In recent years, monitoring services and monitoring devices for ensuring the safety of children, the elderly, etc. and supporting communication have become widespread (see Patent Document 1). For example, there are devices that use the GPS (Global Positioning System) function to notify the current location of the monitored person to the protector's smartphone or the like, and devices that can send and receive simple messages.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] An object of the present invention is to provide a technology capable of supporting appropriate communication according to various situations of a monitored person in a monitored device.
Means for Solving the Problems
[0005] In order to solve the above problems, a monitored device according to an aspect of the present invention displays at least one response candidate to be preferentially displayed on a display according to the ranking of a plurality of response candidates determined based on situation information including the position information, time information, and activity information of the monitored person, and non-displays or secondarily displays other response candidates; a display control unit An input receiving unit that receives at least one of a first operation for confirming a selection of a response candidate displayed on the display and transmitting response information, and a second operation for selecting another response candidate. A response transmission unit that transmits response information corresponding to the selected response candidate to the parent terminal in response to the first operation, It is equipped with. [Effects of the Invention]
[0006] According to one aspect of the present invention, it is possible to support appropriate communication tailored to the diverse circumstances of the person being monitored. [Brief explanation of the drawing]
[0007] [Figure 1] This is a schematic diagram showing the overall configuration of a situation-adaptive, simplified response system according to one embodiment of the present invention. [Figure 2] This is a block diagram showing an example of the hardware configuration of the monitoring device according to this embodiment. [Figure 3] A block diagram showing an example of the hardware configuration of the parental device according to this embodiment. [Figure 4] Block diagram showing an example of the server hardware configuration according to this embodiment. [Figure 5] This figure shows an example of the functional block configuration of the monitoring device according to this embodiment. [Figure 6] This figure shows an example of the functional block configuration of the parental device (app) according to this embodiment. [Figure 7] This figure shows an example of the functional block configuration of the server according to this embodiment. [Figure 8] This flowchart shows an example of the situation determination and response candidate presentation process in this embodiment. [Figure 9] This figure shows an example (initial display) of the response candidate display screen for the monitored device according to this embodiment. [Figure 10]It is a diagram showing an example of a response candidate display screen of the monitored device according to this embodiment (display of other candidates by the second operation). [Figure 11] It is a diagram showing an example of a schedule information registration screen of the guardian terminal according to this embodiment. [Figure 12] It is a diagram showing a specific example of the situation information acquired by the monitored device according to this embodiment. [Figure 13] It is a sequence diagram showing an example of information cooperation among the server, the monitored device, and the guardian terminal in this embodiment. [Figure 14] It is a diagram showing an example of the radial menu UI according to a modification example of this embodiment. [Figure 15] It is a diagram showing an example of response candidate display in the emotion-linked UI according to a modification example of this embodiment. [Figure 16] It is a diagram showing an example of a display screen of the minimal UI mode according to a modification example of this embodiment. [Figure 17] It is a diagram showing an example of the dashboard UI of the guardian terminal according to this embodiment. [Figure 18] It is a diagram showing an example of the AI recommendation degree / response candidate customization UI of the guardian terminal according to this embodiment. [Figure 19] It is a diagram showing an example of the communication / action history UI of the guardian terminal according to this embodiment. [Figure 20] It is a diagram showing an example of the detailed living area setting UI of the guardian terminal according to this embodiment. [Figure 21] It is a conceptual diagram of the recommendation degree calculation logic by AI in this embodiment. [Figure 22] It is a diagram showing a configuration example of the hierarchical learning model in this embodiment.
Mode for Carrying Out the Invention
[0008] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In each figure, the same or corresponding components are denoted by the same reference numerals, and redundant descriptions are omitted as appropriate. In the present specification, components described as "parts" can be realized by dedicated hardware, a processor that realizes a predetermined function by a program, or a combination thereof.
[0009] (Overview of the entire system) FIG. 1 is a schematic diagram showing the overall configuration of a situation-adaptive simple response system 1 according to an embodiment of the present invention. This system 1 mainly includes a ward device 10 possessed by a ward (e.g., a child) PSN, a protector terminal 20 used by a protector GRD, and a server 30 communicably connected to these via a network NW. The ward device 10 can correspond to, for example, a user terminal 100. The protector terminal 20 is, for example, a smartphone or a PC, and provides an interface for checking the location information and situation of the ward PSN. The server 30 functions as, for example, a monitoring system 10 and performs processing and management of various information. The network NW can include, in addition to the Internet and a mobile phone network, a local network via a Wi-Fi (registered trademark) router 61. Also, the system 1 may cooperate with a positioning server 40 for assisting in positioning.
[0010] The ward device 10 is a wearable device that determines the situation of the ward PSN and supports the selection and transmission of response candidates suitable for the situation with a simple operation. For example, a form in which a circular display is provided in a small housing of about 5 cm square is conceivable. The protector terminal 20 is, for example, a smartphone or a tablet terminal, and by executing a dedicated application (hereinafter, protector app 20A), it receives and displays information from the ward device 10, sets the ward device 10, or transmits a message to the ward device 10. Server 30 works in conjunction with the monitored device 10 and the guardian terminal 20 to comprehensively support the functions of the entire system 1, including AI model learning and management, advanced situational judgment processing, and database management of various information.
[0011] (Description of hardware configuration) Figure 2 is a block diagram showing an example of the hardware configuration of the monitored device 10 according to this embodiment. The monitored device 10 includes a CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, RAM (Random Access Memory) 103, a communication interface (I / F) 104, a display 105, an input unit 106, a GPS receiver 107, various sensors 108, and a battery 109. These are interconnected via a bus 110. The communication interface 104 includes, for example, an LPWA (Low Power Wide Area) communication module and a SIM card slot, providing communication functionality via a cellular network or Wi-Fi network. The input unit 106 includes a touch panel as well as one or more physical buttons. The various sensors 108 may include an accelerometer, gyroscope, geomagnetic sensor, illuminance sensor, temperature sensor, microphone, and the like.
[0012] Figure 3 is a block diagram showing an example of the hardware configuration of the parental terminal 20 according to this embodiment. The parental terminal 20 includes a CPU 201, ROM 202, RAM 203, communication I / F 204, display 205, input unit 206, and storage unit 207, etc. These are interconnected via a bus 208. Since these components are similar to those found in typical smartphones and tablet devices, a detailed explanation is omitted. The parental application 20A is stored in the storage unit 207.
[0013] Figure 4 is a block diagram showing an example of the hardware configuration of the server 30 according to this embodiment. The server 30 includes a CPU 301, ROM 302, RAM 303, communication I / F 304, and storage unit 305, etc. These are interconnected via a bus 306. Since these components are similar to those found in a typical server computer, a detailed explanation is omitted. The storage unit 305 stores AI models, various databases, etc.
[0014] (Explanation of functional block configuration) Next, the functional block configuration of each device according to this embodiment will be described. These functional blocks are mainly realized by the CPU of each device executing a predetermined program.
[0015] Figure 5 shows an example of the functional block configuration of the monitored device 10 according to this embodiment. The monitored device 10 comprises a status acquisition unit 121, a status determination unit 122, a response candidate processing unit 123, a display control unit 124, an input reception unit 125, and a response transmission unit 126 as functional blocks.
[0016] The status acquisition unit 121 has a higher-level function to acquire various information regarding the current status of the monitored person's PSN. To this end, the status acquisition unit 121 may be configured as an intermediate-level functional unit, for example, including a sensor data acquisition unit, an external information receiving unit, and a time information acquisition unit (none of which are shown). The sensor data acquisition unit acquires location information (GPS location information) obtained from the GPS receiving unit 107, and activity information, biometric information, voice information, and limited visual information (basic elements of facial expressions, presence or absence of surrounding objects and people, etc.) obtained from various sensors 108 (e.g., acceleration sensor, gyro sensor, geomagnetic sensor, illuminance sensor, temperature sensor, heart rate sensor, skin electrical activity sensor, microphone, miniature camera, etc.). The external information receiving unit acquires auxiliary location information based on Wi-Fi access point information and mobile phone base station information, schedule information as a means of calendar linking, weather information, etc. from the server 30 and guardian terminal 20 via the communication I / F 104. The time information acquisition unit acquires the current time information from an internal clock (not shown). Each of these components performs specific lower-level processing, such as data reading from the corresponding hardware or information reception processing according to the communication protocol. Figure 12 shows an example of the status information that the status acquisition unit 121 can acquire.
[0017] The situation determination unit 122 has a higher-level function that determines the current status of the person being monitored (PSN) based on the multifaceted situation information acquired by the situation acquisition unit 121. To this end, the situation determination unit 122 may be configured to include, for example, a situation information analysis unit, a situation estimation / classification unit, and a recommendation level calculation unit (none of which are shown) as intermediate-level functional units. The situation information analysis unit performs preprocessing, such as extracting features and removing noise from the diverse situation information input. The situation estimation and classification unit estimates or classifies the current specific situation of the person being monitored (PSN) using a pre-trained model and analyzed situational information. This trained model may have a hierarchical or ensemble structure that combines multiple specialized models (such as the activity recognition model 2201, the emotion estimation assistance model 2202, the place / time context understanding model 2203, and the response history learning model 2204), as shown in Figure 22. These models are built and maintained in a hybrid approach where a base model trained and generated on the server 30 using large-scale data (e.g., actual children's behavior logs, feedback from guardians, and examples of desirable responses under specific circumstances) is delivered to the monitored device 10, and then fine-tuned on the device side by the learning means 127 (on-device learning function) to suit the characteristics of each individual child. This allows for higher-quality judgments that go beyond simply identifying location and activity status, including estimations of the monitored person's emotional state and nuances related to their safety, such as "excitedly playing with friends in the park (increased heart rate + loud voice + smiling + location is a park + time is after school)" or "lost and feeling anxious (increased heart rate + deviation from a specific location + no speech + stiff expression)." This can lead to estimations of the child's potential needs and predictions of their next actions. Based on this advanced situation assessment result, the recommendation score calculation unit dynamically weights multiple factors to calculate the AI recommendation score for each response candidate, as shown in Figure 21. Factors considered include the urgency and importance assessment result of the situation 2101, the estimated emotional state of the person being monitored (PSN) 2102, the customized rules (parent settings) 2103 set from the parent terminal 20, the past response selection history (personalization information) 2104 of the person being monitored (PSN), and the keyword analysis result 2105 of the message content received from the parent terminal 20. These factors are dynamically weighted (weighting processing unit 2106) using methods such as fuzzy logic, rule-based systems, or reinforcement learning, depending on the urgency of the situation, the age setting of the person being monitored (PSN), or the parent settings, and are assigned to each response candidate as the final recommendation score (recommendation score list 2107).
[0018] The response candidate processing unit 123 has a higher-level function of ranking and determining multiple response candidates based on the situation determined by the situation determination unit 122 and the recommendation score calculated by the AI. To this end, the response candidate processing unit 123 may be configured to include, for example, a response candidate selection / generation unit and a response candidate ranking unit (neither of which are shown) as intermediate-level functional units. The response candidate selection / generation unit selects an appropriate response candidate (mainly in icon format, but may also include short text or emotion icons (corresponding to Appendix 9)) from a pre-stored response candidate database (not shown) according to the determined situation, or dynamically generates the content of the response candidate according to the situation. The response candidate ranking unit ranks the selected or generated multiple response candidates based on the recommendation score by the AI. In this case, the response candidate processing unit 123 does not necessarily present a large number of candidates in all situations. Instead, it may dynamically adjust the number of response candidates presented depending on the urgency and clarity of the situation as determined by the situation judgment unit 122, or the distribution of recommendations by the AI (for example, whether one candidate has a significantly high recommendation level, or whether multiple candidates have equally high recommendations). For example, if the situation is judged to be extremely urgent, or if the child is very young, the number of options may be narrowed down to one or two to minimize the burden of decision-making.
[0019] The display control unit 124 has a higher-level function of displaying response candidates on the display 105 based on the ranking (and recommendation level) determined by the response candidate processing unit 123. To this end, the display control unit 124 may be configured as an intermediate-level functional unit, for example, a display layout determination unit, a main candidate display processing unit, an other candidate display control unit, and a status icon display processing unit (none of which are shown). The display layout determination unit determines the optimal display layout by considering the size and characteristics of the display 105 (e.g., a circular display), the current situation, the number and types of determined response candidates, and the estimated emotional state of the person being monitored (PSN). For example, as shown in Figure 9, the response candidate icon 901 with the highest recommendation level is displayed in the center of the display, larger than other candidates, and visually more prominent. Alternatively, in a radial menu UI 1400 as shown in Figure 14, the response candidate icon with the highest recommendation level is placed in a more easily operable position, or the display style (color tone, animation) of the response candidates is changed according to the estimated emotional state, as shown in Figure 15. The primary candidate display processing unit displays one or a few preferred response candidates on the display 105 using this optimized layout and display style. This allows the monitored person (PSN) to intuitively recognize the most likely response without having to search through numerous options, enabling quick decision-making. This significantly contributes to reducing response time and improving the certainty of selection, especially in emergencies or when the child is confused. The other candidate display control unit may either hide other response candidates or display them in a secondary manner (for example, by displaying them small in the corner of the display 105, or by changing the transparency according to the degree of recommendation). The status icon display processing unit may display a status icon (for example, a school icon, a park icon, etc.) indicating the current status determined by the status determination unit 122 on the display 105 along with the response candidates (corresponding to Appendix 8).
[0020] The input receiving unit 125 has a higher-level function of receiving selection input of the monitored person's PSN in response to the response candidates displayed on the display 105. To this end, the input receiving unit 125 may be configured as an intermediate-level functional unit, for example, including a first operation receiving unit, a second operation receiving unit, a touch operation detection unit, and a physical button input detection unit (none of which are shown). The touch operation detection unit detects tap operations and swipe operations on the display 105 (if it is integrated with a touch panel). The physical button input detection unit detects press operations (short press, long press, double-click, etc.) of physical buttons included in the input unit 106. The first operation reception unit receives a first operation to confirm the selection of a displayed response candidate icon and send response information. This first operation may be, for example, a combination of a tap operation on a response candidate icon detected by the touch operation detection unit and a subsequent press operation of a physical button detected by the physical button input detection unit (corresponding to Appendix 13). This confirmation step using a physical button has technical significance in that it effectively prevents accidental transmissions due to unintended taps, which are particularly likely to occur when children operate small devices while moving, and increases the reliability of the response. Alternatively, under certain circumstances (for example, in an emergency or in minimal UI mode), a single operation (such as a long press of a physical button, a specific swipe, or a tap of the entire screen) may be accepted as the first operation (corresponding to Appendix 15). The second operation reception unit receives a second operation that causes the display control unit 124 to sequentially display other response candidates based on the ranking. This second operation may be, for example, a swipe operation in a predetermined direction (e.g., up or down) on the display 105 detected by the touch operation detection unit (corresponding to Appendix 14). Upon receiving this second operation, the display control unit 124 displays the next response candidate to be displayed on the display 105 according to the ranking determined by the response candidate processing unit 123. Figure 10 shows an example screen in which other response candidate icons 1001 are displayed by the second operation. This allows children to easily explore other options with minimal cognitive load.
[0021] When the first operation is received by the input reception unit 125, the response transmission unit 126 transmits response information corresponding to the response candidate whose selection was confirmed by that operation to the parent terminal 20 via the communication interface 104.
[0022] The monitored device 10 may further include a learning means 127 (corresponding to Appendix 6) that learns the history of past response candidate selections by the monitored person's PSN and the circumstances at the time, and personalizes the recommendation level by AI based on the learning results. The learning means 127 performs AI recommendation level personalization as a higher-level function. To this end, the learning means 127 may be configured as a component function unit as an intermediate concept, for example, a response history collection unit, a learning model update unit (in the case of on-device learning), and a personalization parameter adjustment unit (none of which are shown). The response history collection unit stores the history of response selections received by the input reception unit 125 and the circumstances judgment results by the circumstances judgment unit 122 at that time. The learning model update unit updates a part of the learned model used by the circumstances judgment unit 122 and the parameters of the recommendation level calculation logic on the device (on-device learning) based on the collected history data and feedback from the guardian. The personalization parameter adjustment unit adjusts the recommendation calculation rules referenced by the response candidate processing unit 123, as well as user preference parameters used by the display control unit 124 when determining the display mode. Each of these units performs specific lower-level processes such as recording selection history, providing feedback to the model, and statistical analysis, and works in cooperation with the situation judgment unit 122 and the response candidate processing unit 123.
[0023] Figure 6 shows an example of the functional block configuration of the parent terminal 20 (parent application 20A) according to this embodiment. The parent application 20A includes a communication control unit 221, a display processing unit 222, an input processing unit 223, a setting management unit 224, and a schedule information management unit 225 as functional blocks.
[0024] The communication control unit 221 communicates with the monitored device 10 and the server 30 via the network NW. For example, it receives response information and status information from the monitored device 10, obtains various setting information from the server 30, and sends messages and setting information to the monitored device 10 and the server 30. The display processing unit 222 displays the received response information, status information, or various information within the application on the display 205. The input processing unit 223 receives operation input from the input unit 206 by the parent / guardian GRD.
[0025] The settings management unit 224 receives and manages setting information regarding the content of response candidates displayed on the monitored device 10 and the AI-based recommendation rules for response candidates, in response to input operations from the parent GRD. The managed setting information is transmitted to the monitored device 10 or the server 30 via the communication control unit 221 and used for customization by the response candidate processing unit 123 of the monitored device 10 (part of the processing corresponding to Appendix 7).
[0026] The schedule information management unit 225 registers the weekly schedule information (including at least the day of the week, start time, end time, and activity details) of the person being monitored (PSN) in response to input operations from the guardian GRD, and stores it in the storage unit 207. Figure 11 shows an example of the schedule information registration screen. On this screen 1100, the day of the week 1101, start time 1102, end time 1103, and activity details (such as location and purpose) 1104 are entered, and the schedule is registered by pressing the register button 1105. The registered schedule information is transmitted via the communication control unit 221 to the monitored device 10 or the server 30 for use in situation assessment on the monitored device 10.
[0027] Figure 7 shows an example of the functional block configuration of the server 30 according to this embodiment. The server 30 comprises a communication unit 321, a processing unit 322, and a storage unit 323 as functional blocks. The storage unit 323 corresponds to the storage unit 305 in Figure 4 and stores a trained AI model, a user database (including identification information of the person being monitored and the guardian GRD, the guardian's contact information, registered living area location information, various setting information, schedule information, etc.), a status history database (accumulating status information uploaded from the monitored device 10 in chronological order), and the like. The processing unit 322 may include a group of modules that perform various processes necessary for the operation of this system 1, such as registration management processing, information notification processing, living area determination processing, map information creation processing, living area correction processing, setting processing, alarm notification processing, and battery level checking processing.
[0028] The communication unit 321 has higher-level functions that communicate with the monitored device 10 and the guardian terminal 20 via the network NW. To this end, the communication unit 321 may be configured to include, for example, a data transmission / reception processing unit and an API (Application Programming Interface) management unit (neither of which are shown) as intermediate-level functional units. The data transmission / reception processing unit performs actual data transfer processing, such as receiving status information from the monitored device 10, receiving schedule information and setting information from the guardian terminal 20, and sending instruction information and updated AI models to the monitored device 10. The API management unit provides an interface for cooperation with external devices and systems.
[0029] The processing unit 322 has higher-level functions that perform various information processing on the server 30. To this end, the processing unit 322 may be configured as an intermediate-level functional unit that includes, for example, a situation judgment support unit, a response candidate determination support unit, an AI model learning / update unit, a data analysis unit, a user authentication unit, and various management program execution units (none of which are shown). The situation judgment support unit uses situation information received from the monitored device 10 and the AI model and database information of the storage unit 323 to perform more advanced situation judgment processing and feeds the results back to the device. Similarly, the response candidate determination support unit assists in determining response candidates and calculating recommendation levels. The AI model learning / update unit performs learning processing to periodically or as needed update the trained AI model of the storage unit 323 based on situation information and response selection history collected from multiple monitored devices. The data analysis unit analyzes accumulated situation history data and performs tasks such as generating statistical information and extracting anomaly detection patterns. The user authentication unit performs access authentication from devices and applications. The various management program execution units perform various processes necessary for the operation of this system 1, such as registration management processing, information notification processing, living area determination processing, map information creation processing, living area correction processing, setting processing, alarm notification processing, and battery level monitoring processing. Each of these units performs specific lower-level processes such as large-scale data processing, machine learning pipeline execution, and database query processing. The processing results (for example, more advanced situation judgment results, response candidate indications, recommendation level indications, updated AI models, etc.) are transmitted to the monitored device 10 via the communication unit 321 and used for situation judgment, display of response candidates, or AI recommendation level determination in the monitored device 10.
[0030] (Explanation of the processing flow) Figure 8 is a flowchart showing an example of the situation judgment and response candidate presentation process in this embodiment. This process is mainly performed by the CPU 101 of the monitored device 10, which functions as a response candidate processing unit 123 and a display control unit 124, but some processes (for example, advanced situation judgment and use of AI models) may be performed in cooperation with the server 30.
[0031] First, the monitored device 10 determines whether or not it has received a message from the guardian terminal 20 (step S801). If it has not received a message (NO in S801), the process enters a standby state or executes other processes. If it has received a message (YES in S801), the status determination unit 122 determines the current status of the monitored person's PSN (step S802). This status determination is made based on various information (location, time, activity, schedule, etc.) acquired by the status acquisition unit 121 and a learned model.
[0032] Next, the response candidate processing unit 123 ranks and selects multiple response candidates based on the determined situation and the recommendation level by the AI (step S803). Then, the display control unit 124 primarily displays one or a few response candidates that should be displayed preferentially on the display 105 based on the ranking (step S804). At this time, the other response candidates are hidden or displayed secondarily.
[0033] Next, the input receiving unit 125 waits for operation input from the monitored person's PSN (step S805). If operation input is received, it is determined whether or not it is a first operation (selection confirmation and transmission) (step S806). If it is a first operation (YES in S806), the response transmission unit 126 sends response information corresponding to the selected response candidate to the guardian terminal 20 (step S807), and the process ends.
[0034] If it is not the first operation (NO in S806), it is determined whether the operation is the second operation (request for sequential display of other candidates) (step S808). If it is the second operation (YES in S808), the display control unit 124 displays the other response candidates to be displayed next on the display 105 according to the ranking determined by the response candidate processing unit 123 (step S809), and returns to step S805 to wait for operation input. If it is not the second operation either (NO in S808), it returns to step S805, or a timeout process is performed if there is no operation for a predetermined time (not shown).
[0035] This invention effectively utilizes the functions of a computer (monitored device, parent terminal, and server), and in particular, in the monitored device, significantly improves the usability of the computer for children's responses through AI-driven situational judgment and dynamic optimization of the user interface (display of response candidates and operation methods) based on that judgment. Specifically, by dynamically adjusting the amount of information presented and the complexity of operations according to the situation, taking into account the limited display area and the cognitive abilities of children, the interaction with the computer becomes more intuitive and error-free. This contributes to the improvement of user interfaces in the field of human-computer interaction.
[0036] (Variations and other embodiments) It should be noted that the present invention is not limited to the embodiments described above, and various modifications are possible without departing from the spirit of the invention. For example, in the above embodiments, the monitored device, the guardian terminal, and the server are described as separate devices, but some or all of these functions may be integrated, or they may be distributed across more devices. Furthermore, it is possible to construct new embodiments by appropriately combining the components of each embodiment.
[0037] (Example 1: Expansion of situational information) In the above embodiment, the situation acquisition unit 121 may also include, in addition to GPS, time, acceleration sensor, and schedule information, vital sensors to acquire biometric information of the person being monitored (e.g., heart rate, body temperature), a microphone to collect ambient sounds, or a small camera to acquire limited visual information. In this case, the situation judgment unit 122 can perform more advanced and multifaceted situation judgments by comprehensively analyzing this diverse sensor information, such as estimating the emotional state of the person being monitored (e.g., excitement, anxiety, normality) and evaluating the degree of danger in the surroundings (e.g., detection of loud collision sounds, simple recognition of specific hazardous objects). As a result, the response candidate processing unit 123 can determine response candidates that are more in line with the internal state and external environment of the person being monitored, and the display control unit 124 can optimize the display mode, thereby further improving the quality of communication and the level of safety assurance support.
[0038] (Modification 2: Enhanced personalization through on-device learning) In the above embodiment, the learned model used by the situation determination unit 122 and the AI recommendation score referenced by the response candidate processing unit 123 may be, in addition to, those delivered from the server 30, or alternatively, the monitored device 10 itself may continuously learn (on-device learning) the daily behavioral patterns of the monitored PSN, frequently selected response candidates, and reaction tendencies under specific circumstances, and sequentially update and personalize the model and recommendation score based on the learning results. This on-device learning function (for example, performed by the learning means 127) enables response support that is quickly and precisely adapted to the individuality and environmental changes of each monitored PSN, and is expected to improve privacy protection (by reducing the frequency of sending sensitive personal data outside the device) and maintain and improve the ability to adapt to situations in offline environments.
[0039] (Modification 3: Advanced response candidate processing and display control - Introduction of reinforcement learning) In the above embodiment, the response candidate processing unit 123 and the display control unit 124 not only present response candidates based on the recommendation level by the AI, but may also optimize the response candidate presentation strategy itself (which candidates to present, at what timing, and in what display manner) using reinforcement learning techniques. For example, the system learns feedback as a reward, such as whether communication with the guardian GRD proceeded smoothly as a result of the monitored PSN selecting a particular response candidate (e.g., a quick affirmative response or a message of gratitude from the guardian), or whether the monitored PSN's stress was reduced (e.g., estimated from changes in vital signs), and autonomously adjusts the response candidate selection logic and display control parameters so that the most effective response support can be provided in the long term. As a result, the more the system is used, the more "thoughtful" the response support becomes for each individual monitored PSN.
[0040] (Variation 4: Advanced response candidate processing and display control - AR and haptic feedback) With an eye on future advancements in device form factors, the display control unit 124 may be configured to use AR (augmented reality) technology to overlay response candidate icons onto the monitored PSN's real-world field of view, or, in cooperation with the input reception unit 125, to attract the monitored PSN's attention or assist in selection through haptic feedback such as device vibration patterns when a specific response candidate is recommended. This would enable more intuitive and effective response support, especially when the surrounding environment is complex or when visual information alone is insufficient to attract attention.
[0041] (Variation 5: Diversification of input acceptance and operation methods - Voice and gesture input) In the above embodiment, the first and second operations received by the input receiving unit 125 are not limited to touch operations or physical button operations. For example, it may also be possible to select and confirm response candidates by voice commands from the monitored person's PSN (e.g., specific keyword utterances such as "yes" or "later"), or to enable simple responses by gesture input that detects specific movements of the monitored device 10 (e.g., shaking, tilting). This makes it possible to perform response operations even when hands are unavailable or when the user cannot focus on the screen, thereby improving convenience.
[0042] (Variation 6: Diversification of input acceptance and operation methods - Dynamic modification of physical button functions) In the above embodiment, the physical buttons (part of the input unit 106) may be configured to dynamically change their function according to the situation determined by the situation determination unit 122. For example, a physical button that normally operates as the "confirm" function in the first operation will automatically switch to the "send SOS and a predetermined emergency response" function when pressed and held by the situation determination unit 122 if it is determined that there is a high possibility of an emergency situation. This helps to ensure that the most important operations can be performed more reliably and quickly, even in situations where the monitored person's PSN is confused.
[0043] (Variation 7: System Integration - Utilization of Blockchain Technology) In this system 1, blockchain technology may be introduced to record and manage sensitive information such as the location information of the person being monitored (PSN), response history, and logs of AI-generated situation assessments in a way that is difficult to tamper with and highly transparent. This will enhance the reliability of the data and ensure traceability of information disclosure to the guardian GRD and, if necessary, to third parties with legitimate authority (e.g., law enforcement agencies during searches), thereby contributing to a better balance between privacy protection and information utilization.
[0044] (Example 8: System Integration - Integration with IoT Devices) The status acquisition unit 121 may be configured to acquire status information not only from sensors mounted on the monitored device 10, but also from IoT (Internet of Things) devices in the surrounding area (for example, smart speakers, smart lighting, security cameras in the home, or school access control systems, public environmental sensors, etc.) via a network NW. Alternatively, the monitored device 10 may be configured to control the operation of surrounding IoT devices based on response information from the response transmission unit 126 and the status judgment results from the status judgment unit 122 (for example, issuing a warning from a smart speaker at home in an emergency, or activating the air conditioner at home when responding to returning home). This enables situation judgment based on a wider range of information and response-linked functions that are more closely integrated with daily life.
[0045] (Variation 9: Interdisciplinary Application - Elderly Care) The core technology of the present invention can also be applied to monitoring and supporting communication with the elderly. In this case, the situation acquisition unit 121 focuses on acquiring the elderly person's activity level, sleep patterns, medication status (in conjunction with a pill case with a sensor), vital signs (heart rate, blood pressure, body temperature, etc.), and indoor environmental information (temperature, humidity, presence of people, etc.). The situation judgment unit 122 determines the elderly person's health status, daily living activities, and signs of an emergency from this information. The response candidate processing unit 123 and the display control unit 124 present response candidates related to expressions of intent such as "I feel good / bad," "I took my medicine / I haven't taken it," "I need help," and "I want to contact my family," as well as requests for daily living support such as "Turn on the air conditioner" and "Change the TV channel," in a manner that is easy for the elderly person to see and operate (for example, large icons, combined voice reading, one-touch operation, etc.).
[0046] (Trimming technique 10: Interdisciplinary application - Medicine and rehabilitation) The present invention can also be applied to support communication for patients with speech difficulties or postoperative patients. The situation acquisition unit 121 acquires the patient's vital signs, posture, treatment schedule, pain scale (to assist subjective input), etc. The situation judgment unit 122 estimates the patient's condition and potential needs from this information. The response candidate processing unit 123 and the display control unit 124 present "location and intensity of pain," "mood (nausea, dizziness, etc.)," and "requests (water, toilet, change of position, nurse call)" using icons and diagrams that are easy to communicate nonverbally, and the input reception unit 125 can handle various input methods according to the patient's condition, such as eye-tracking input and brainwave switching (BCI).
[0047] (Torture 11: Interdisciplinary Application - Work Support / Industrial Sector) This system can also be applied to ensuring worker safety and supporting communication in hazardous and high-stress environments such as factories, construction sites, and firefighting operations. The situation acquisition unit 121 acquires the worker's vital signs, surrounding environmental sensor information (toxic gases, oxygen concentration, temperature, etc.), and the operating status of work equipment. The situation judgment unit 122 detects hazardous situations and worker abnormalities from this information. The display control unit 124 displays warning icons and work instructions on a helmet-integrated display, etc., and the input reception unit 125 accepts simple responses via voice commands and specific gestures.
[0048] (Variation 12: Interdisciplinary Application - Language Learning / Special Education) This system can also be applied to support communication for foreign language learners and people with developmental disabilities. The situation assessment unit 122 estimates the learner's level and current social situation (e.g., shopping, greeting). The response candidate processing unit 123 and the display control unit 124 present expressions (icons, fixed phrases, etc.) that are considered appropriate for the situation, according to the learner's level, and may also include features such as pronunciation practice.
[0049] (Variation 13: Interdisciplinary Application - Entertainment / Games) If a game is playable on the device, the system can be applied to dynamically present dialogue options and action hints with NPCs in a way that does not disrupt the game's world, based on the AI's assessment of the game player's situation (in-game actions, emotions, skill level, etc.) while maintaining the game's atmosphere. The display control unit 124 presents response candidates as UI elements within the game screen and links them with haptic feedback from the controller.
[0050] (Variation 14: UI Variation - Radial Menu UI) In the above embodiment, the display control unit 124 may display response candidates in a radial menu format, which is particularly suitable as a UI for a monitored device 10 having a circular display 105. Figure 14 shows an example of a radial menu UI. In this example, a plurality of response candidate icons 1402a, 1402b, 1402c, etc., determined by the response candidate processing unit 123 are arranged radially around the central area 1401 of the display 105 (e.g., message reception notification and status icon display area). Response candidate icons with a high recommendation score by the AI may be displayed larger, positioned at a more easily operable angle (e.g., a position that takes into account the dominant hand), or highlighted with a different color or animation. The input receiving unit 125 may, for example, highlight the response candidate icon to be selected by a rotation operation of the display 105 (e.g., rotation of the physical bezel or an arc-shaped swipe operation on the touch panel), and accept a first operation to confirm the selection by a tap operation or physical button press. Alternatively, the first action may be a direct tap on the display area of each response candidate icon. Such a radial menu UI makes effective use of limited display space while helping children intuitively select response candidates.
[0051] (Variation 15: UI Variation - Emotion-Responsive UI) In the above embodiment, when the situation determination unit 122 estimates the emotional state of the person being monitored (e.g., joy, sadness, anger, anxiety, normal, etc.) based on information from vital sensors, microphones, small cameras, etc., as described in Modification 1, the display control unit 124 and the response candidate processing unit 123 may dynamically change the display manner and content of the response candidates according to the estimated emotional state. Figure 15 shows an example of the display of response candidates in the emotion-linked UI. For example, if the person being monitored is estimated to be in a "joyful" state (1501), the response candidate icon 1502 (e.g., "Happy!" or a smiling emoji) may be displayed with bright colors and fun animations, or response candidates with positive content may be presented preferentially. Conversely, if the person is estimated to be in an "anxious" state (1503), the response candidate icon 1504 (e.g., content such as "I need help" or "I'm worried" or an anxious-looking emoji) may be displayed in calm colors and in a large size for easy selection, or response candidates prompting contact with a guardian may be presented with the highest priority. By linking the estimated emotional state with the response interface in this way, it is expected that children will be able to communicate their emotions more accurately, and parents will be able to understand the nuances of their children's emotions more easily.
[0052] (Variation 16: UI Variation - Minimal UI Mode) In the above embodiment, the display control unit 124 may switch to a minimal UI mode that simplifies the response interface to the greatest extent possible under certain circumstances. Figure 16 shows an example of a display screen in minimal UI mode. For example, if the situation determination unit 122 determines that the person being monitored (PSN) is in a situation requiring extreme concentration (e.g., during an exam or an important presentation, based on pre-set settings by the guardian), or if the battery level of the monitored device 10 is significantly low, the display control unit 124 intentionally limits the number of response candidates to one (e.g., only the emergency contact icon 1601 or a simple "understood" icon) and displays it large and clearly using the entire display 105. In this mode, the display of other response candidates by a second operation is restricted or disabled. The input reception unit 125 accepts a simple operation on this single display (e.g., a tap on the entire screen or a short press of a physical button) as the first operation. Such a minimal UI mode minimizes the cognitive and operational burden on the child and helps ensure that the most important responses and information are conveyed.
[0053] (Variation 17: UI Variation - UI Theme Change via Parental Controls) In the above embodiment, the parent GRD may be configured to select or customize the user interface theme of the monitored device 10 (e.g., icon style set, color scheme, display font type and size, background image, sound effects during operation, etc.) from multiple options according to the monitored person PSN's age, gender, preferences, or specific needs regarding visibility and operability (e.g., a high-contrast theme for visually impaired children) via the parent app 20A (such as the settings management unit 224 in Figure 6) on the parent terminal 20.
[0054] (Variation 18: Complementary and collaborative use of user input for situational judgment) In the above embodiment, the situation determination by the situation determination unit 122 mainly involves automatic estimation and determination based on a learned model, but is not limited thereto. For example, it may accept user input from the monitored device 10 or the guardian terminal 20 (for example, an operation in which the monitored person PSN or the guardian GRD explicitly selects the current situation mode such as "at school," "playing," or "emergency"), and combine the selected situation mode with the determination result from the learned model, or use it as supplementary situation information when it is difficult for the learned model to make a determination. In this case, the response candidate processing unit 123 can determine and rank response candidates by comprehensively considering the situation mode selected by the user and the recommendation level of the AI (for example, response candidates that have been frequently selected in that mode in the past). Furthermore, when a specific situation mode is selected, it is possible to implement hybrid control in which a fixed set of response candidates and display order associated with that mode are applied preferentially, while the recommendation level of the AI is used only for fine-tuning within that set (for example, highlighting some candidates). In this way, by combining automatic judgment by a trained model with explicit situation specification by the user, flexible and reliable situation-adaptive response support that is more in line with the user's intentions can be realized.
[0055] (Example 19: Situation-Adaptive Operating System) In the above embodiment, the first and second operations received by the input receiving unit 125 do not necessarily have to be physically different buttons or clearly distinguishable gestures. For example, a single user action (e.g., a tap on a displayed icon) may be configured to dynamically switch between functioning as a first operation (selection confirmation and transmission) and functioning as a second operation (displaying other response candidates or initiating a confirmation step before transmission) depending on the confidence level of the situation determination by the situation determination unit 122 and the recommendation level of the response candidates determined by the response candidate processing unit 123 (in particular, whether the recommendation level of the highest priority candidate is significantly higher than that of other candidates). Specifically, if the user has high confidence in their situational assessment and a single response candidate is presented with a very high recommendation level, tapping on that response candidate is considered a direct response transmission (completion of the first operation), simplifying the operation steps. On the other hand, if the user has low confidence in their situational assessment or if multiple response candidates are presented, the initial tap is treated as a provisional selection of a response candidate. Subsequently, other related response candidates are presented (a function similar to the second operation), or a confirmation message such as "Do you want to send?" is displayed, prompting the user to confirm their selection (for example, another tap or pressing a physical button, which is also part of the first operation in a broad sense). This prevents errors while providing an optimal operation flow appropriate to the situation. In this way, the number of basic operations the user performs is kept to a minimum, and the meaning and results of those operations change in conjunction with the AI's situational assessment, further reducing the operational burden on children and encouraging appropriate responses according to the situation.
[0056] (Variation 20: Local recording and local notification of response information) In the above embodiment, the response transmission unit 126 may, in addition to the function of transmitting response information corresponding to the selected response candidate to the guardian terminal 20, or alternatively, be equipped with a log recording function that records the response information and situation information at that time (e.g., location information, time, activity status, etc.) in chronological order in a storage unit (e.g., RAM 103 or a separate non-volatile memory) inside the monitored device 10. The recorded log information can be configured to be transferred all at once later via short-range wireless communication (e.g., Bluetooth®, NFC, etc.) or a wired connection to the guardian terminal 20, or to be directly viewed on the display 105 of the monitored device 10. Furthermore, the response transmission unit 126 (or the display control unit 124 or a separate notification control unit) may, when the situation determination unit 122 determines a specific critical situation (for example, a pre-set emergency, intrusion into a dangerous area, or selection of a specific SOS response by the monitored person's PSN), attempt to transmit remotely via the network NW, or, even if the communication environment is unavailable, have a function to generate local notifications from the monitored device 10 itself, such as a warning sound, vibration, light, or a pre-recorded voice message. This enables warnings and danger notifications to the surroundings in a manner independent of the communication environment. Thus, the concept of "transmission of response information" in the present invention can encompass a wider range of information output and transmission methods, including not only real-time data transmission to a remote parent terminal, but also subsequent transmission through information storage within the device, and immediate local notifications from the device itself.
[0057] (Variation 21: Gradual display of response candidates) In the above embodiment, the display control unit 124 may display the response candidates by gradually or continuously changing the visual prominence of each response candidate based on the ranking (or recommendation level by AI) determined by the response candidate processing unit 123. For example, a gradient expression can be used, such as simultaneously displaying multiple response candidate icons on the display 105, displaying the response candidate icon with the highest recommendation level with the highest opacity (or the darkest color, or the largest size), and gradually decreasing the opacity (or the color, or the size) as the recommendation level decreases, or changing the intensity or prominence of the effects (e.g., glow or border) displayed around the response candidate icon according to the recommendation level. Such a display method can also be considered within the scope of the present invention's technical concept of "primarily displaying one or a few response candidates that should be displayed preferentially, while hiding or secondarily displaying other response candidates," in that it effectively guides the user to choose a response candidate that is highly recommended, thereby attracting their attention and making it easier for them to select that candidate. In this case, the user can recognize multiple options at once, perceive the degree of recommendation by the AI as a visual gradient, and select a response more flexibly.
[0058] (Variation 22: Presentation of AI-generated messages and corresponding response actions) In the above embodiment, the "response candidates" determined by the response candidate processing unit 123 are not limited to those selected and ranked from a predefined set of icons or text. For example, based on the situation of the monitored PSN determined by the situation determination unit 122, the response candidate processing unit 123 (or a cooperating AI module) may dynamically generate a short text message summarizing the situation (e.g., "Playing in the park," "Seems a little tired") or a suggested message that infers the actions the monitored PSN might take or the intentions they want to convey in that situation. In this case, the display control unit 124 can be configured to display the AI-generated message on the display 105 and present a very small number of response actions, such as "Send this content (yes)" or "Do not send (no)" (these can also be interpreted as broad response options). The monitored PSN checks whether the message generated by the AI matches its intentions, and if it does, it selects "yes," which sends the message to the guardian terminal 20. Such configurations can also fall within the scope of the present invention's technical concept, in which the AI assesses the situation and, based on that assessment, assists the monitored PSN in responding. This is particularly effective in situations where it is difficult for the monitored PSN to construct a response themselves, or when they want to convey more specific information to their guardian. In this case, "ranking and deciding on multiple response candidates" can be interpreted as the AI generating a message (the most recommended message) and presenting affirmative / negative actions in response to it, essentially prioritizing and presenting choices.
[0059] (Variation 23: Rule-based situational judgment and response candidate determination) In the above embodiment, the "learned model" used by the situation determination unit 122 is not limited to deep learning models or statistical machine learning models, but may also be a concept that includes a knowledge base or database that stores a set of rules (e.g., an IF-THEN style rule set, a decision tree, etc.) that associate specific patterns in the situation information of the monitored person's PSN with the processing to be performed in response to those patterns (e.g., identification of a specific situation or identification of a set of response candidates to be displayed). In this case, the situation determination unit 122 checks whether the acquired situation information matches any of the condition parts of the rule set, and determines the situation based on the result part of the matching rule. Similarly, the "AI recommendation score" referenced by the response candidate processing unit 123 does not necessarily refer only to a score that is dynamically calculated in real time, but may also refer to a fixed display priority of response candidates set in advance for each situation by the parent GRD via the parent terminal 20, or the rules themselves for selecting a specific set of response candidates. In this case, the response candidate processing unit 123 reads from the storage unit and determines the response candidate set and its fixed priority associated with the situation (or situation pattern that matches the rule) determined by the situation determination unit 122. Thus, a configuration in which the system makes situational judgments and determines and prioritizes response candidates based on a specific rule set defined by the parent can also be included within the scope of the present invention's technical concept of AI providing optimal response support according to the situation. This approach has the advantage of increasing the transparency and predictability of the system's operation and facilitating customization by parents.
[0060] (Variation 24: UI variations for parental device apps - Dashboard UI) Figure 17 shows an example of a dashboard UI 1700 displayed by the parent app 20A of the parent terminal 20 according to this embodiment. This dashboard UI 1700 can function as the home screen that is initially displayed when the parent GRD launches the app. At the top of the screen, summary information 1701 showing the current status of the monitored person's PSN (for example, text such as "At school" or "Playing in the park," a corresponding status icon, the last updated time, etc.) is displayed. In addition, the battery level 1702 of the monitored device 10, a list 1703 of recent important notifications (for example, emergency response, area entry / exit notification, etc.), and a shortcut 1704 to the recent response history are also placed. Furthermore, an area 1705 that briefly displays the current location on a map and quick access buttons 1706 to frequently used functions (sending messages, checking schedules, etc.) may be provided. With such a dashboard UI 1700, the parent GRD can grasp important information about the monitored person's PSN at a glance and quickly.
[0061] (Variation 25: UI variations of the parental device app - AI recommendation level and response candidate customization UI) Figure 18 shows an example of the AI recommendation level / response candidate customization UI 1800 displayed by the parent app 20A of the parent terminal 20 according to this embodiment. This UI 1800 allows the parent GRD to adjust the logic for presenting response candidates on the monitored device 10 to better suit their own preferences and the characteristics of the monitored person's PSN. For example, when a specific situation (e.g., "during school class," "on the way home from cram school," "possible illness") is selected in the situation selection area 1801, the current response candidate list 1802 corresponding to that situation is displayed. The parent GRD can adjust the display priority (weighting of the recommendation level by the AI) for each response candidate icon 1803 in the list using a slider 1804, toggle display / hide, or add new response candidates (custom icons or standard phrases) (edit button 1805). A detailed settings area 1806 may also be provided to set the maximum number of response candidates to display in that situation, and additional actions when a specific response candidate is selected (e.g., immediately notify the parent). The configured settings are sent to the server 30 via the settings management unit 224 and reflected in the processing by the response candidate processing unit 123 of the monitored device 10. This allows parents to more precisely control the response support according to the child's situation.
[0062] (Variation 26: UI variations of the parent device app - Communication and activity history UI) Figure 19 shows an example of a communication and behavior history UI 1900 displayed by the parent app 20A of the parent terminal 20 according to this embodiment. This UI 1900 comprehensively displays the history of communication with the monitored person's PSN, changes in the situation judged by the AI, and movement trajectories in chronological order or on a map. For example, the timeline display area 1901 lists messages sent from the parent GRD 1902, response icons from the monitored person's PSN 1903, AI-based situation judgment notifications (e.g., "Arrived at school" 1904), and area entry / exit notifications, along with the time they occurred. Selecting each item may display detailed information (message content, response time, location information, etc.). Furthermore, pressing the map display switching button 1905 may display the movement trajectory of the monitored person's PSN over a specific period on a map, allowing for overlay confirmation of the situation and response history at each location. With such a history UI 1900, the parent GRD can grasp the details of the child's day and use this information to review communication and understand their daily patterns.
[0063] (Variation 27: UI variations of the parent device app - Detailed living area settings UI) Figure 20 shows an example of the detailed living area setting UI 2000 displayed by the parent application 20A of the parent terminal 20 according to this embodiment. This UI 2000 provides an interface that allows setting multiple living areas (e.g., home, school, cram school, park, etc.) of the person being monitored on the map display area 2001, and intuitively editing (adding, deleting, resizing, etc.) the shape (circular, polygonal, etc.) and range of each living area. For each living area 2002, in addition to setting a name, there is a setting panel 2003 that allows individual settings such as whether or not to send notifications when "entering" and "exiting" the area, the recipient of the notifications, and the operating mode of the monitored device 10 within the area (e.g., automatically switching to silent mode in the school area, prioritizing the display of a specific set of response candidates, etc.). It is also possible to register dangerous areas (e.g., busy roads, bodies of water, etc.) and set the system to send a strong warning to the parent terminal 20 and / or the monitored device 10 when approaching or entering such areas. This detailed living area setting UI2000 allows the parent GRD to configure detailed monitoring settings according to the child's range of activity, thereby improving the accuracy of safety management.
[0064] As described above, it is also possible to construct new embodiments by appropriately combining elements of each embodiment and modification.
[0065] [General tasks] To provide technology that can support appropriate communication in monitoring devices, depending on the diverse circumstances of the person being monitored. To provide a technology for monitoring devices that dynamically optimizes the user interface for responses according to the diverse situations of the person being monitored, thereby reducing the response burden on the person being monitored (especially children), preventing errors, and supporting smooth and appropriate communication.
[0066] [Note 1] [Issues corresponding to Appendix 1] To support appropriate communication in monitoring devices according to the diverse circumstances of the person being monitored. [Contents of Appendix 1] A monitoring device comprising: a situation acquisition unit that acquires situation information including location information, time information, and activity information of the person being monitored; a situation determination unit that determines the situation of the person being monitored based on the situation information, based on a learned model; a response candidate processing unit that ranks and determines a plurality of response candidates based on the determined situation and the recommendation level by the AI; a display control unit that, based on the ranking determined by the response candidate processing unit, primarily displays one or a few response candidates that should be displayed preferentially on the display, while hiding or secondarily displaying other response candidates; an input reception unit that receives a first operation for confirming the selection of a response candidate displayed on the display and transmitting response information, and a second operation for causing the display control unit to sequentially display the other response candidates based on the ranking; and a response transmission unit that transmits response information corresponding to the selected response candidate to the guardian terminal in response to the first operation. [Effects of Appendix 1] The AI assesses the situation of the person being monitored and dynamically optimizes the display method and access method of response candidates based on that situation and the AI's recommendation level. This reduces the response burden on the person being monitored, prevents errors, and supports smooth and appropriate communication. According to Appendix 1, the AI comprehensively analyzes multifaceted situational information such as the location, time, and activity of the person being monitored, as well as biometric information, voice, visual information, and schedules, to make sophisticated situational judgments that include nuances of the child's emotional state and safety status. Based on the judgment results and the recommendation score calculated by the AI by dynamically weighting factors such as the urgency of the situation, the child's estimated emotions, parent settings, past response history, and received message content, the response candidate processing unit determines the content and ranking of response candidates. Based on this decision, the display control unit presents the response candidates in an optimized display manner that minimizes the cognitive load on the child and reduces the likelihood of errors. For example, it might prominently display the response candidate with the highest recommendation score in the center of the display, while hiding other candidates or displaying them sequentially with a simple second operation such as swiping. The input reception unit enables reliable response selection and transmission through a first operation, such as a combination of tapping and pressing a physical button. This allows those being monitored (especially children) to intuitively and quickly select responses without having to engage in complex thinking or exploration tailored to their situation and abilities, significantly reducing the response burden compared to conventional technologies. It also effectively prevents accidental transmissions of unintended responses. As a result, parent-child communication becomes smoother and of higher quality, and parents gain a more accurate and detailed understanding of their child's situation, leading to a significant improvement in emotional security—a remarkable effect that was difficult to achieve with conventional monitoring devices. For example, even in emergency situations where a child is confused, the optimal SOS response is presented as the top priority, and an input method that is less prone to errors is provided, which is expected to dramatically improve the success rate of rescue requests. Furthermore, in everyday situations, the presentation of response options that take into account the child's emotions and intentions allows children to express their feelings more actively, contributing to a deeper emotional bond between parent and child.
[0067] [Note 2] [Issues corresponding to Appendix 2] To provide specific means for acquiring activity information. [Contents of Appendix 2] The monitored device described in Appendix 1, wherein the status acquisition unit further comprises an acceleration sensor for acquiring the activity information. [Effects of Appendix 2] By using an acceleration sensor, more specific activity information can be obtained, contributing to improved accuracy in situational judgment.
[0068] [Note 3] [Issues related to Appendix 3] To provide information to further improve the accuracy of situational judgment. [Contents of Appendix 3] A monitoring device as described in Appendix 1 or 2, wherein the status acquisition unit further comprises a calendar linkage means for acquiring the schedule information of the person being monitored, and the status determination unit uses the schedule information to improve the accuracy of the status determination of the person being monitored. [Effects of Appendix 3] By incorporating schedule information obtained through calendar integration into situational assessment, more accurate and contextually relevant situational assessment becomes possible.
[0069] [Note 4] [Issues corresponding to Appendix 4] To provide information to further improve the accuracy of situational judgment. [Contents of Appendix 4] A monitoring device as described in any one of Appendix 1 to 3, wherein the situation acquisition unit further acquires at least one of the biological information, voice information, and visual information of the person being monitored, and the situation determination unit uses the additionally acquired information to determine the situation of the person being monitored. [Effects of Appendix 4] By utilizing multifaceted information such as biometric information, auditory information, and visual information in situational judgment, it is possible to gain a deeper understanding of the emotional state of the person being monitored and the surrounding circumstances, and to significantly improve the accuracy of situational judgment.
[0070] [Note 5] [Challenges corresponding to Appendix 5] Adding the ability to make situational judgments related to a specific area. [Contents of Appendix 5] A monitoring device as described in any one of Appendix 1 to 4, wherein the situation determination unit determines whether the location information is within a specific area that has been registered in advance, and uses the determination result to determine the situation of the person being monitored. [Effects of Appendix 5] It becomes possible to recognize the user's movements in and out of specific areas (school, cram school, home, etc.) and their presence there, enabling situational judgment and response support accordingly.
[0071] [Note 6] [Challenges corresponding to Appendix 6] Adding the ability to make situational judgments using distance information from a specific reference point. [Contents of Appendix 6] A monitoring device as described in any one of Appendix 1 to 5, wherein the situation determination unit calculates the distance from the monitored person's home based on the location information and pre-registered home location information, and determines the situation of the monitored person by referring to the calculated distance and / or its change. [Effects of Appendix 6] By understanding the distance from home and how it changes, the accuracy of detecting situations such as getting lost or approaching dangerous areas can be improved.
[0072] [Note 7] [Challenges related to Appendix 7] To provide a function that adapts and personalizes the AI recommendation level to individual users. [Contents of Appendix 7] A monitoring device as described in any one of Appendix 1 to 6, wherein the learned model is sequentially updated on the monitoring device based on the response selection history or behavioral patterns of the person being monitored. [Effects of Appendix 7] On-device learning enables personalized response support tailored to the individual characteristics and preferences of each person being monitored, improving usability and contributing to privacy protection.
[0073] [Note 8] [Issues related to Appendix 8] To increase the degree of customization by parents. [Contents of Appendix 8] A monitored device as described in any one of Appendix 1 to 7, wherein the response candidate processing unit customizes the content of the available response candidates or the AI recommendation calculation rules based on the setting information received from the guardian terminal that has been set in advance. [Effects of Appendix 8] Because parents can customize response options and AI recommendation rules, it becomes possible to provide response support that is more tailored to the family situation and the child's characteristics.
[0074] [Note 9] [Issues corresponding to Appendix 9] To make it easier for the person being monitored to recognize their own situation. [Contents of Appendix 9] A monitored device according to any one of Appendix 1 to 8, wherein the display control unit displays on the display a status icon indicating the current status determined by the status determination unit, along with a response candidate determined by the response candidate processing unit. [Effects of Appendix 9] By displaying icons that indicate the current situation, the person being monitored can more easily objectively recognize the situation, which helps them to select an appropriate response.
[0075] [Note 10] [Challenges corresponding to Appendix 10] To improve the expressiveness of responses. [Contents of Appendix 10] A monitored device according to any one of Appendix 1 to 9, wherein the response candidate determined by the response candidate processing unit includes an emotion icon indicating the emotions of the person being monitored. [Effects of Appendix 10] By using emotion icons, the person being monitored can communicate their emotions more easily and accurately, improving the quality of communication.
[0076] [Note 11] [Challenges related to Appendix 11] To improve the adaptability of response candidates according to specific locations and time periods. [Contents of Appendix 11] A monitored device as described in any one of Appendix 1 to 10, wherein the response candidate processing unit determines the response candidate by selecting an appropriate one from a predetermined set of multiple response candidate sets according to the location and / or time period determined by the situation determination unit. [Effects of Appendix 11] By switching the set of response candidates depending on the location and time of day, it becomes possible to provide more contextually appropriate response support.
[0077] [Note 12] [Issues corresponding to Appendix 12] Expanding the means of information presentation. [Contents of Appendix 12] A monitored device as described in any one of Appendix 1 to 11, wherein the monitored device further comprises a second display provided on the side of the device in addition to the display (hereinafter referred to as the first display), and the display control unit displays the response candidates on the first display and also displays auxiliary information regarding the current status, the operating status of the device, or notifications from the guardian terminal on the second display. [Effects of Appendix 12] By providing a second display, supplementary information can be effectively presented without interfering with the display on the main display.
[0078] [Note 13] [Issues corresponding to Appendix 13] To improve the specificity of information presented by the second display. [Contents of Appendix 13] A monitored device as described in Appendix 12, wherein the display control unit changes the display mode of the second display (at least one of the color, flashing pattern, or display icon) according to the current situation determined by the situation determination unit. [Effects of Appendix 13] By changing the display mode of the second display according to the situation, the effectiveness of information transmission to the person being monitored and those around them can be enhanced.
[0079] [Note 14] [Issues corresponding to Appendix 14] To identify specific aspects of the first operation and enhance the effectiveness of preventing errors. [Contents of Appendix 14] A monitored device as described in any one of Appendix 1 to 13, wherein the first operation received by the input receiving unit includes a tap operation on a response candidate icon on the display and a subsequent pressing operation of a physical button. [Effects of Appendix 14] By combining tap operations and physical button presses, unintended responses are prevented, and the reliability of operations is improved.
[0080] [Note 15] [Issues corresponding to Appendix 15] To specify the specific details of the second operation. [Contents of Appendix 15] A monitored device according to any one of Appendix 1 to 14, wherein the second operation received by the input receiving unit is a swipe operation in a predetermined direction on the display. [Effect of Appendix 15] Swiping gestures make it intuitive and easy to access other response options.
[0081] [Note 16] [Issues related to Appendix 16] To simplify operations and enable rapid response in emergencies. [Contents of Appendix 16] A monitored device according to any one of Appendix 1 to 15, wherein when the situation determination unit determines a predetermined emergency situation, the response candidate processing unit determines a single response candidate for emergency contact, the display control unit displays it, and the input reception unit accepts a single operation for the emergency response candidate as the first operation. [Effects of Appendix 16] By simplifying operations to the greatest extent possible in emergencies, it supports quick and reliable emergency communication.
[0082] [Note 17] [Issues related to Appendix 17] Increase the variety of input methods to improve usability. [Contents of Appendix 17] A monitoring device according to any one of the appendices 1 to 16, wherein the input receiving unit further includes a voice recognition unit, and the first operation or the second operation can be executed by a specific voice command. [Effects of Appendix 17] By enabling operation via voice commands, it becomes possible to respond even in situations where hands are unavailable.
[0083] [Note 18] [Challenges related to Appendix 18] To enable users to specify the situation and increase the flexibility of situational judgment. [Contents of Appendix 18] A monitoring device as described in any one of Appendix 1 to 17, wherein the situation determination unit receives mode information indicating the current situation input by the person being monitored or a guardian, corrects the situation determination result by the learned model based on the mode information, or switches the set of response candidates determined by the response candidate processing unit based on the mode information. [Effects of Appendix 18] By allowing users to explicitly specify the situation mode, it complements the AI's automatic decision-making and enables response support that better aligns with the user's intentions.
[0084] [Note 19] [Challenges related to Appendix 19] To increase the flexibility of the operating system and provide the optimal operating flow according to the situation. [Contents of Appendix 19] A monitored device as described in any one of Appendix 1 to 18, wherein the input receiving unit performs control to dynamically switch whether a single user operation on a displayed response candidate functions as the first operation or the second operation, based on the degree of confidence of the situation determination by the situation determination unit or the degree of recommendation of the response candidate by the response candidate processing unit. [Effects of Appendix 19] By dynamically assigning a single user operation to different functions depending on the situation, it is possible to reduce the learning burden of operation while achieving both speed and reliability.
[0085] [Note 20] [Problems corresponding to Appendix 20] To provide means for recording response information and status information. [Contents of Appendix 20] A monitored device as described in any one of Appendix 1 to 19, wherein the response transmission unit further includes a log recording means for recording response information corresponding to the selected response candidate and status information at that time in the internal memory of the monitored device. [Effects of Appendix 20] By recording response information and status information within the device, it becomes possible to save the information even when there is no communication environment, and to check or transfer it later.
[0086] [Note 21] [Issues related to Appendix 21] To provide a local notification function for emergencies. [Contents of Appendix 21] A monitored device according to any one of Appendix 1 to 20, wherein the monitored device further comprises notification control means that generates a local notification from the monitored device itself by at least one of a warning sound, vibration, light, or voice message when the situation determination unit determines a specific emergency situation. [Effects of Appendix 21] By issuing emergency warnings from the device itself, regardless of the communication environment, it becomes possible to quickly alert the person being monitored and those around them.
[0087] [Note 22] [Issues related to Appendix 22] To provide variations in the method of displaying response candidates. [Contents of Appendix 22] A monitoring device according to any one of Appendix 1 to 21, wherein the display control unit displays a plurality of response candidates simultaneously on the display, each with different visual prominence (e.g., transparency, saturation, size, or intensity of added effects) based on the ranking determined by the response candidate processing unit or the recommendation level by AI. [Effects of Appendix 22] By displaying multiple response options simultaneously with varying visual prominence according to their recommendation level, it is possible to provide users with freedom of choice while also offering gentle guidance from AI.
[0088] [Note 23] [Issues corresponding to Appendix 23] To provide a method in which AI-generated information is used as a response candidate. [Contents of Appendix 23] A monitoring device as described in any one of Appendix 1 to 22, wherein the response candidate determined by the response candidate processing unit includes summary information about the state or intention of the person being monitored, generated by AI based on the situation determined by the situation determination unit, and the first operation received by the input reception unit is an operation to approve the summary information and transmit it to the guardian terminal. [Effects of Appendix 23] By having the AI generate a message summarizing the situation and responding with an acknowledgment operation, the response burden on the person being monitored can be further reduced, and more specific information can be conveyed.
[0089] [Note 24] [Challenges corresponding to Appendix 24] To provide a specific embodiment of the learning model. [Contents of Appendix 24] A monitoring device as described in any one of Appendix 1 to 23, wherein the learned model includes at least a set of rules that associate a predetermined pattern of the monitored person's situation information with a set of response candidates corresponding to the pattern and their display priority, the situation determination unit determines a corresponding situation when the current situation information matches any of the patterns in the set of rules, and the response candidate processing unit ranks and determines the plurality of response candidates based on the set of response candidates corresponding to the determined situation and their display priority. [Effects of Appendix 24] By using a rule-based model, the transparency of the system's operation can be increased, making it easier for parents to customize it, while also enabling situation-appropriate response support.
[0090] [Note 25] [Challenges corresponding to Appendix 25] To provide a proactive information transmission support function using AI. [Contents of Appendix 25] A monitoring device as described in any one of Appendix 1 to 24, wherein the response candidate processing unit generates a notification message summarizing information about the state or activity of the person being monitored when it determines that a predetermined situation determined by the situation determination unit is a situation in which reporting to the guardian terminal is recommended without an explicit response request from the person being monitored, and the display control unit displays the notification message and at least one approval operation instruction for selecting whether or not to send the notification message to the guardian terminal as the response candidate. [Effects of Appendix 25] By having the AI assess the situation, proactively suggest information sharing, and allowing the user to respond by approving it, opportunities for communication can be increased, and parents' sense of security can be enhanced.
[0091] [Note 26] [Issues related to Appendix 26] To provide a means for parents to effectively manage and utilize schedule information in conjunction with the monitored device on their parental device. [Contents of Appendix 26] An information processing method for a person being monitored, which is performed on a parent terminal, comprising: receiving response information selected by the person being monitored and status information relating to the current status of the person being monitored from the monitored device; displaying the received response information and the status information on the display of the parent terminal; registering and storing weekly schedule information of the person being monitored, which includes at least the day of the week, start time, end time, and activity content, in response to an input operation by the parent; and transmitting the registered and stored schedule information to the monitored device or a server cooperating with the monitored device for use in status determination on the monitored device. [Effects of Appendix 26] By utilizing the schedule information registered by the guardian to assess the status of the monitored device, the accuracy of the situation assessment can be improved, enabling more appropriate response support and monitoring.
[0092] [Note 27] [Issues related to Appendix 27] Further enhance the degree of customization by parents. [Contents of Appendix 27] The information processing method according to Appendix 26, further comprising the step of receiving setting information regarding the content of response candidates displayed on the monitored device or the AI recommendation level calculation rules for the response candidates in response to an input operation by a guardian, and transmitting the setting information to the monitored device or the server. [Effects of Appendix 27] By allowing parents to set detailed response options and AI recommendation rules, it becomes possible to operate a monitoring system that is more tailored to individual needs.
[0093] [Note 28] [Challenges related to Appendix 28] To provide a server that efficiently performs AI processing and data management as a whole system, and enhances the functionality of the monitored devices. [Contents of Appendix 28] A server that is communicably connected to at least one monitored device and at least one guardian terminal via a network, comprising: a communication unit that receives status information regarding the current status of the monitored person from the monitored device and / or setting information regarding the monitored person's schedule information and response candidates from the guardian terminal; a processing unit that performs at least one of the following based on the received status information, schedule information, setting information and a pre-stored trained AI model: a process that determines the current status of the monitored person, or a process that determines response candidates to be displayed on the monitored device and their AI recommendation level; and a communication unit that transmits instruction information or an updated AI model used for status determination, display of response candidates, or determination of AI recommendation level on the monitored device to the monitored device based on the processing result of the processing unit. [Effects of Appendix 28] By having the server take on the core role of AI processing and data management, the load on the monitored devices is reduced, while enabling advanced situational judgment, response support, and efficient management and distribution of AI models.
[0094] [Note 29] [Challenges related to Appendix 29] To provide a function for continuous improvement of the AI model. [Contents of Appendix 29] The server described in Appendix 28, wherein the processing unit further performs a learning process to update the trained AI model based on the status information and response selection history received from multiple monitored devices. [Effects of Appendix 29] By utilizing information from multiple devices to continuously learn and update the AI model, the overall system's situational judgment accuracy and the quality of response support can be improved.
[0095] [Note A1] A display control unit that, based on the ranking of multiple response candidates determined based on situation information including the location information, time information, and activity information of the person being monitored, displays at least one response candidate that should be displayed preferentially on the display, while hiding or displaying other response candidates secondarily. An input receiving unit that receives at least one of a first operation for confirming a selection of a response candidate displayed on the display and transmitting response information, and a second operation for selecting another response candidate. A response transmission unit that transmits response information corresponding to the selected response candidate to the parent terminal in response to the first operation, A monitoring device equipped with the following features. [Appendix A2] A monitoring device as described in Appendix A1, further comprising an acceleration sensor for acquiring the activity information. [Note A3] A monitoring device as described in Appendix A1, wherein the status information is acquired based on the schedule information of the person being monitored. [Note A4] A monitoring device as described in Appendix A1, wherein the situation information includes at least one of the following: biometric information, voice information, and visual information of the person being monitored. [Note A5] A monitored device as described in Appendix A1, wherein the status information includes information on whether or not the location information is within a specific area that has been pre-registered. [Note A6] A monitoring device as described in Appendix A1, wherein the situation information includes information on the distance between a pre-registered home location and the location of the person being monitored. [Note A7] A monitoring device as described in Appendix A1, wherein the ranking of the plurality of response candidates is determined on the monitoring device based on AI learned based on the response selection history or behavioral patterns of the person being monitored. [Note A8] A monitoring device as described in Appendix A1, wherein the content of the available response candidates is set based on setting information received from a pre-configured parent terminal. [Note A9] A monitoring device as described in Appendix A1, wherein the display control unit displays a status icon indicating the current status of the person being monitored, along with a determined response candidate, on the display. [Note A10] A monitoring device as described in Appendix A1, wherein the selected response candidate includes an emotion icon indicating the emotions of the person being monitored. [Note A11] A monitoring device as described in Appendix A1, wherein the response candidate is determined from a predetermined set of multiple response candidate sets depending on the location and / or time of the person being monitored. [Note A12] A monitored device as described in Appendix A1, wherein the monitored device further comprises a second display provided on a different surface from the first display, in addition to the display (hereinafter referred to as the first display), and the display control unit displays the response candidates on the first display and displays auxiliary information regarding the current status, the operating status of the device, or notifications from the guardian terminal on the second display. [Note A13] A monitoring device as described in Appendix A12, wherein the display control unit changes the display mode of the second display according to the current status of the person being monitored. [Note A14] A monitored device as described in Appendix A1, wherein the first operation received by the input receiving unit includes a tap operation on a candidate response icon on the display and a press operation on a physical button. [Note A15] A monitoring device as described in Appendix A1, wherein the second operation received by the input receiving unit is a swipe operation in a predetermined direction on the display. [Note A16] A monitored device as described in Appendix A1, wherein, in the event of a predefined emergency situation, a single response candidate for emergency contact is determined, the display control unit displays it, and the input receiving unit accepts a single operation for the emergency response candidate as the first operation. [Note A17] A monitoring device as described in Appendix A1, wherein the input receiving unit further includes a voice recognition unit, and the first operation or the second operation can be executed by a specific voice command. [Note A18] A monitoring device as described in Appendix A1, wherein the AI-based situation assessment result is corrected or a set of response candidates is switched based on mode information indicating the current situation, which is input by the person being monitored or their guardian. [Note A19] A monitored device as described in Appendix A1, wherein the input receiving unit dynamically switches whether a single user operation on a displayed response candidate functions as the first operation or the second operation, based on the degree of confidence in the situation judgment or the degree of recommendation of the response candidate. [Note A20] A monitored device as described in Appendix A1, wherein the response transmission unit records response information corresponding to the selected response candidate and status information at that time in the internal memory of the monitored device. [Note A21] A monitored device as described in Appendix A1, wherein in the event of a specific emergency situation, the monitored device itself generates a notification by at least one of the following: a warning sound, vibration, light, or voice message. [Note A22] A monitoring device as described in Appendix A1, wherein the display control unit displays multiple response candidates on the display, each with a different visual prominence based on ranking or AI recommendation level. [Note A23] A monitoring device as described in Appendix A1, wherein the response candidates include summary information about the state or intentions of the person being monitored, generated by AI based on the situation information, and the first operation received by the input receiving unit is an operation to approve the summary information and transmit it to the guardian's terminal. [Note A24] A monitoring device as described in Appendix A1, wherein, based on a learning model that includes at least a set of rules associating predetermined patterns of the monitored person's situation information with a set of response candidates corresponding to the pattern and their display priority, the device determines a corresponding situation when the current situation information matches any of the patterns in the set of rules, and ranks the multiple response candidates based on the set of response candidates corresponding to the determined situation and their display priority. [Note A25] A monitoring device as described in Appendix A1, wherein, when a predetermined situation determined based on the situation information is a situation in which reporting to the guardian terminal is recommended without an explicit response request from the person being monitored, the device generates a notification message summarizing information about the state or activity of the person being monitored, and the display control unit displays the notification message and at least one approval operation instruction for selecting whether or not to send the notification message to the guardian terminal as response candidates. [Note A26] The steps include receiving response information selected by the person being monitored, and status information regarding the current situation of the person being monitored, The steps include displaying the received response information and the status information on the display of the parent terminal, A schedule information registration step in which, in response to input operations by the guardian, schedule information of the person being supervised, including at least the day of the week, start time, end time, and activity content, is registered and stored. The steps include transmitting the registered and stored schedule information to the monitored device or a server cooperating with the monitored device in order to use it for situation determination in the monitored device, A program that causes a computer to execute something. [Note A27] A server connected via a network to communicate with at least one monitored device and at least one guardian terminal, A communication unit that receives status information regarding the current status of the person being monitored from the monitoring device, and / or receives setting information regarding the person being monitored's schedule and response candidates from the guardian terminal, A processing unit that performs at least one of the following based on the received status information, schedule information, setting information, and a pre-stored trained AI model: a process that determines the current status of the person being monitored, or a process that determines response candidates to be displayed on the device being monitored and the degree of recommendation of those responses by the AI; Based on the processing results by the processing unit, the communication unit transmits instruction information or an updated AI model used for situation assessment, display of response candidates, or determination of the degree of recommendation by AI to the monitored device, A server equipped with the following features. [Explanation of symbols]
[0096] 1… Situation-adaptive simplified response system 10…Monitoring device 20…Parental device 20A... Parental app 30... Server 101, 201, 301…CPU 102, 202, 302…ROM 103, 203, 303…RAM 104, 204, 304… Communication Interface (Communication I / F, Communication Section) 105, 205… Display 106, 206… Input section 107...GPS receiver 108... Various sensors 110, 208, 306… buses 121... Situation acquisition unit 122... Situation Assessment Department 123...Response candidate processing unit 124...Display Control Unit 125... Input reception section 126...Response transmission unit 127…Learning methods 221...Communications Control Unit 222... Display Processing Unit 223... Input Processing Unit 224…Settings management department 225…Schedule Information Management Department 321... Communications Department 322... Processing Unit 323...Storage section 901... Response candidate icon (initial display) 902... Situation icon 1001... Response candidate icon (shows other candidates) 1100...Schedule information registration screen 1101... Day of the week input field 1102... Start time input field 1103... End time input field 1104... Activity details input field 1105...Register button 1201... Timestamp 1202... Device identification number 1203…GPS location information 1204…Wi-Fi location information 1205...Base station location information 1206...Battery level information 1401…Central area 1402a, 1402b, 1402c… Response candidate icons (radial menu) 1501...Estimated emotional state: "Joy" 1502...Response candidate icon (joy) 1503...When the emotional state is estimated to be "anxiety" 1504... Response candidate icon (anxiety) 1601…Emergency contact icon (minimalist UI) 1700… Dashboard UI 1701...Current Situation Summary Information 1702...Battery level 1703…Important Notices List 1704... Response history shortcut 1705...Location information simplified display area 1706... Quick Access Button 1800... AI recommendation level / Response candidate customization UI 1801... Situation Selection Area 1802... Response candidate list 1803... Response candidate icon (customizable UI) 1804...Priority adjustment slider 1805... Edit button 1806...Detailed settings area 1900... Communication and behavioral history UI 1901...Timeline display area 1902...Message sent from parent / guardian 1903... Response icon from the person being monitored 1904... AI-based situation assessment notification 1905...Map display toggle button 2000...Detailed Living Area Settings UI 2001…Map display area 2002 (2002a, 2002b)... Living area 2003…Settings panel 2101...Result of assessing the urgency and importance of the situation 2102... Estimated emotional state of the person being cared for 2103...Parental Controls 2104... Past response selection history 2105... Keyword analysis results of received message content 2106...Weighting Processing Unit 2107…Recommendation List 2201…Activity Recognition Model 2202... Emotion estimation support model 2203…Location-Time Context Understanding Model 2204...Response history learning model NW...Network PSN... The one being watched over GRD...Parent S801~S809...Step S1301~S1311... Sequence
Claims
1. A display control unit that, based on the ranking of multiple response candidates determined based on situation information including the location information, time information, and activity information of the person being monitored, displays at least one response candidate that should be displayed preferentially on the display, while hiding or displaying other response candidates secondarily. An input receiving unit that receives at least one of a first operation for confirming a selection of a response candidate displayed on the display and transmitting response information, and a second operation for selecting another response candidate. A response transmission unit that transmits response information corresponding to the selected response candidate to the parent terminal in response to the first operation, A monitoring device equipped with the following features.
2. A monitoring device according to claim 1, further comprising an acceleration sensor for acquiring the activity information.
3. A monitoring device according to claim 1, wherein the status information is acquired based on the schedule information of the person being monitored.
4. A monitoring device according to claim 1, wherein the situation information includes at least one of the following: biometric information, voice information, and visual information of the person being monitored.
5. A monitoring device according to claim 1, wherein the status information includes information on whether or not the location information is within a specific area that has been pre-registered.
6. A monitoring device according to claim 1, wherein the situation information includes information on the distance between a pre-registered home location and the location of the person being monitored.
7. A monitoring device according to claim 1, wherein the ranking of the plurality of response candidates is determined on the monitoring device based on AI learned based on the response selection history or behavioral patterns of the person being monitored.
8. A monitoring device according to claim 1, wherein the content of the available response candidates is set based on setting information received from a pre-configured guardian terminal.
9. A monitoring device according to claim 1, wherein the display control unit displays a status icon indicating the current status of the person being monitored, along with a determined response candidate, on the display.
10. A monitoring device according to claim 1, wherein the selected response candidate includes an emotion icon indicating the emotions of the person being monitored.
11. A monitoring device according to claim 1, wherein the response candidate is determined from a predetermined set of response candidates depending on the location and / or time of the person being monitored.
12. A monitored device according to claim 1, wherein the monitored device further comprises a second display provided on a different surface from the first display, in addition to the display (hereinafter referred to as the first display), and the display control unit displays the response candidates on the first display and displays auxiliary information regarding the current status, the operating status of the device, or notifications from the guardian terminal on the second display.
13. A monitoring device according to claim 12, wherein the display control unit changes the display mode of the second display according to the current status of the person being monitored.
14. A monitored device according to claim 1, wherein the first operation received by the input receiving unit includes a tap operation on a response candidate icon on the display and a press operation on a physical button.
15. A monitoring device according to claim 1, wherein the second operation received by the input receiving unit is a swipe operation in a predetermined direction on the display.
16. A monitored device according to claim 1, wherein, in the event of a predefined emergency situation, a single response candidate for emergency contact is determined, the display control unit displays it, and the input receiving unit accepts a single operation for the emergency response candidate as the first operation.
17. A monitoring device according to claim 1, wherein the input receiving unit further includes a voice recognition unit, and the first operation or the second operation is executable by a specific voice command.
18. A monitoring device according to claim 1, wherein the AI-based situation judgment result is corrected or a set of response candidates is switched based on mode information indicating the current situation input by the person being monitored or a guardian.
19. A monitored device according to claim 1, wherein the input receiving unit dynamically switches whether a single user operation on a displayed response candidate functions as the first operation or the second operation, based on the degree of confidence in the situation judgment or the degree of recommendation of the response candidate.
20. A monitored device according to claim 1, wherein the response transmission unit records response information corresponding to the selected response candidate and status information at that time in the internal memory of the monitored device.
21. A monitoring device according to claim 1, wherein in the event of a specific emergency situation, the monitoring device itself generates a notification by at least one of a warning sound, vibration, light, or voice message.
22. A monitoring device according to claim 1, wherein the display control unit displays a plurality of response candidates on the display, each with different visual prominence based on ranking or AI recommendation level.
23. A monitoring device according to claim 1, wherein the response candidates include summary information relating to the state or intentions of the person being monitored, generated by AI based on the situation information, and the first operation received by the input receiving unit is an operation to approve the summary information and transmit it to the guardian terminal.
24. A monitoring device according to claim 1, wherein, based on a learning model that includes at least a set of rules associating a predetermined pattern of the monitored person's situation information with a set of response candidates corresponding to the pattern and their display priority, a corresponding situation is determined when the current situation information matches any of the patterns in the set of rules, and the plurality of response candidates are ranked based on the set of response candidates corresponding to the determined situation and their display priority.
25. A monitoring device according to claim 1, wherein if a predetermined situation determined based on the situation information is a situation in which reporting to a guardian terminal is recommended without an explicit request for response from the person being monitored, the device generates a notification message summarizing information about the state or activity of the person being monitored, and the display control unit displays the notification message and at least one approval operation instruction for selecting whether or not to send the notification message to the guardian terminal as response candidates.
26. The steps include receiving response information selected by the person being monitored, and status information regarding the current situation of the person being monitored, The steps include displaying the received response information and the status information on the display of the parent terminal, A schedule information registration step in which, in response to input operations by the guardian, schedule information of the person being supervised, including at least the day of the week, start time, end time, and activity content, is registered and stored. The steps include transmitting the registered and stored schedule information to the monitored device or a server cooperating with the monitored device in order to use it for situation determination in the monitored device, A program that causes a computer to execute something.
27. A server connected via a network to communicate with at least one monitored device and at least one guardian terminal, A communication unit that receives status information regarding the current status of the person being monitored from the monitoring device, and / or receives setting information regarding the person being monitored's schedule and response candidates from the guardian terminal, A processing unit that performs at least one of the following based on the received status information, schedule information, setting information, and a pre-stored trained AI model: a process that determines the current status of the person being monitored, or a process that determines the candidate response to be displayed on the monitored device and the degree of recommendation of that response by the AI; Based on the processing results by the processing unit, the communication unit transmits instruction information or an updated AI model used for situation assessment, display of response candidates, or determination of the degree of recommendation by AI to the monitored device, A server equipped with the following features.