Information processing equipment, information processing method, program, monitoring system

Abstract

We provide a monitoring system that balances ensuring user safety with minimizing the nuisance caused by alarm sounds to the surrounding area. [Solution] The monitoring system comprises a monitoring terminal 10 for monitoring users and a monitoring terminal 20 that can communicate with the monitoring terminal 10. The monitoring terminal 10 comprises an output unit that outputs sound and a volume control unit that controls the volume of the sound output from the output unit. The volume control unit selects one volume level from among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, based on predetermined conditions, and outputs sound from the output unit at the selected volume level.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, a program, and a monitoring system including the information processing apparatus that control an output volume according to a user's state.

Background Art

[0002] In recent years, various technologies have been proposed for monitoring the safety of children, the elderly, and the like. For example, a system that uses a mobile terminal equipped with a GPS (Global Positioning System) function and allows a guardian or the like to remotely check its location information has become widespread. In addition, a security buzzer that generates an alarm sound to notify the surroundings of an abnormality when a user feels danger is also widely used.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, conventional general security buzzers and terminals equipped with a GPS function have room for improvement in terms of functions and the like.

[0005] The present disclosure has been made in view of the problems of the prior art as described above, and an object thereof is to provide a monitoring system with better convenience than before.

Means for Solving the Problems

[0006] To solve the above problems, a monitoring system according to one aspect of the present disclosure is a monitoring system comprising a monitoring terminal carried by a user and a surveillance terminal, wherein the monitoring terminal comprises an output unit that outputs sound and a volume control unit that controls the volume of the sound output from the output unit, and the volume control unit selects one volume level from among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, based on predetermined conditions, and outputs sound from the output unit at the selected volume level. [Brief explanation of the drawing]

[0007] [Figure 1] This is a schematic diagram showing the overall configuration of a monitoring system according to one embodiment of the present disclosure. [Figure 2] Figure 1 is a block diagram showing an example of the hardware configuration of a monitoring terminal. [Figure 3] Figure 1 is a block diagram showing an example of the hardware configuration of a monitoring terminal. [Figure 4] Figure 1 shows the main functional block configuration of the monitoring terminal. [Figure 5] This flowchart shows the main flow of the volume control process in this embodiment. [Figure 6] This figure shows an example of the data structure of guardian-configured geofence information in this embodiment. [Figure 7] This is a screen transition diagram showing an example of the user interface of the monitoring terminal in this embodiment. [Figure 8] This is a perspective view showing the external appearance of the monitoring terminal and a schematic of the alarm activation mechanism according to this embodiment. [Figure 9] This block diagram shows in more detail the internal configuration and main information flow of the state determination unit shown in Figure 4. [Figure 10] Figure 4 is a flowchart showing an example of the conditional judgment logic for selecting each volume mode in the volume mode selection unit. [Figure 11]This sequence diagram shows a specific example of how the volume of the initial notification sound is adjusted according to the geographical location of the monitoring device in normal notification mode. [Figure 12] This is a conceptual diagram illustrating an example of the logic for determining the complex "predetermined emergency conditions" that trigger the transition to emergency alert mode. [Figure 13] This sequence diagram shows the main processing flow when the server is involved in controlling the volume of the monitoring terminal as an optional configuration. [Figure 14] This sequence diagram shows the processing flow when an intervention command, such as changing the volume level, is sent from a monitoring terminal to a surveillance terminal. [Figure 15] This figure shows an example of the structure of log data recorded in the memory of a monitoring device. [Modes for carrying out the invention]

[0008] The embodiments of this disclosure will be described in detail below with reference to the drawings. In each drawing, identical or corresponding components are denoted by the same reference numerals, and redundant explanations are omitted as appropriate. It should be noted that the main terms used in this specification, such as "volume level," "predetermined conditions," "monitoring terminal," "surveillance terminal (surveillance entity)," and "volume control unit," may be defined and interpreted in a broad sense.

[0009] Conventional personal alarms have a problem in that they emit a loud alarm regardless of whether the user activates it unintentionally or a child sets it off as a prank, causing unnecessary nuisance to those around them. Furthermore, the loud volume is also generated during the test activation to confirm that the alarm is functioning correctly, making it difficult to conduct tests discreetly, especially in apartment buildings, due to consideration for neighbors. This difficulty in conducting tests increases the risk that the personal alarm may not function when needed.

[0010] According to one aspect of the present invention, the volume control unit of the monitoring terminal selects one volume level from among several types of volume levels (broadly speaking, including substantial auditory warning levels that can also be identified by sound patterns, timbres, etc.) based on predetermined conditions (including dynamic judgment by AI and external instructions, etc.), and outputs sound at that volume level. This makes it possible to select a relatively small volume level (or a first volume level with acoustic characteristics that are less likely to disturb the surroundings) in the initial stages when it is judged that there is a high possibility of user error or tampering, or during terminal operation testing, while on the other hand, when specific conditions are met in which it is judged that the user is in a truly dangerous situation, it is possible to select a larger volume level (or a second volume level with acoustic characteristics that indicate a high degree of urgency) and generate an alarm sound. As a result, it is possible to suppress the nuisance that the alarm device causes to the surroundings and increase social acceptance, while reliably ensuring the safety of the user, thereby solving the above problem. Furthermore, since the form of use of the monitoring terminal is not limited to "carrying" it, it can contribute to monitoring users in a wider variety of scenarios. Furthermore, features that allow external observation of volume level selection results and related information, as well as logging functions, can contribute to verifying the operational reliability of the system and improving the ease of understanding and verifying the situation in the event of an emergency.

[0011] (Overview of the entire system) Figure 1 is a schematic diagram showing the overall configuration of the monitoring system 1 according to this embodiment. The monitoring system 1 mainly comprises a monitoring terminal 10 used by or accompanying a user U (e.g., a child or an elderly person who requires monitoring; not shown) and a monitoring terminal 20 (or, in a broader sense, a monitoring entity that receives information from the monitoring terminal 10 and enables confirmation and intervention by the user P) held and operated by a guardian P (e.g., a relative or caregiver of the user; not shown). The monitoring terminal 10 and the monitoring terminal 20 (or monitoring entity) are configured to communicate directly or indirectly via a predetermined wireless communication network NW (e.g., a mobile phone network, an LPWA (Low Power Wide Area) network, the Internet, etc.). The monitoring device 10 can be used in a variety of ways, including being worn directly on the user U's body, carried as clothing or personal belongings, incorporated into items used by the user such as strollers, wheelchairs, bicycles, and bags, installed in specific locations in the user's living space (e.g., bedroom, bathroom), or mounted in a vehicle.

[0012] Furthermore, communication between the monitoring terminal 10 and the surveillance terminal 20 (surveillance entity) can take various architectures, such as direct P2P communication, communication via a local network, or cloud-based communication via the server 30. Flexible system configurations, such as sharing information from one monitoring terminal to multiple surveillance terminals (or surveillance entities, such as family smartphones or emergency call systems), or conversely, integrating and managing information from multiple monitoring terminals on a single surveillance terminal (or surveillance platform), are also within the scope of this disclosure.

[0013] If necessary, the monitoring system 1 may be configured to include a server 30 disposed on the network NW. The server 30 can aggregate and manage position information and status information from the monitoring terminal 10, receive setting information from the monitoring terminal 20, or distribute wide-area area information (e.g., danger area information and safe area information provided by the manufacturer) to the monitoring terminal 10 and the monitoring terminal 20. Further, the server 30 can perform advanced situation judgment and risk analysis using AI (artificial intelligence), etc., based on the information collected from the monitoring terminal 10 and information from external information sources, and play a role in transmitting the results (e.g., recommended warning levels and specific instructions) to the monitoring terminal 10 and the monitoring terminal 20. FIG. 13 is a sequence diagram showing an example of the flow of main processes in such a server cooperation configuration. As shown in FIG. 13, the monitoring terminal 10 collects sensor information, etc. (M1301) and transmits it to the server 30 (M1302). The server 30 performs advanced situation judgment using AI, etc., based on the received information and external information, etc. (M1303), and returns the judgment result (risk level, recommended volume level, etc.) to the monitoring terminal 10 (M1304). The volume control unit 409 of the monitoring terminal 10 evaluates this received result as a "predetermined condition" (M1305), selects the final volume level, and outputs sound (M1306). If necessary, the server 30 also notifies the monitoring terminal 20 of the situation (M1307).

[0014] (Description of Hardware Configuration) First, the hardware configuration of the monitoring terminal 10 will be described. FIG. 2 is a block diagram showing an example of the hardware configuration of the monitoring terminal 10. As shown in FIG. 2, the monitoring terminal 10 includes a control unit 101, a storage unit 102, a communication unit 103, a GPS reception unit 104, an output unit 105, an input unit 106, a sensor unit 107, and a power supply unit 108, which are interconnected via a system bus 109.

[0015] The control unit 101 is composed of a CPU (Central Processing Unit), MPU (Micro Processing Unit), etc., and controls the overall operation of the monitoring terminal 10 by executing various programs (for example, a program for realizing the volume control process described later) stored in the storage unit 102.

[0016] The storage unit 102 is composed of non-volatile memories such as ROM (Read Only Memory), RAM (Random Access Memory), flash memory, etc. The ROM stores a boot program, firmware, etc. that the control unit 101 executes. The RAM is used as a work area for the control unit 101 and temporarily stores various programs and data during processing. The non-volatile memory such as flash memory stores, in addition to the control program, area information described later, voiceprint data of the user, various setting values, and further log data (described later, see FIG. 15) such as the selection history of the volume level and operating conditions.

[0017] The communication unit 103 is composed of a wireless communication interface circuit, etc., and performs wireless communication with the monitoring terminal 20 (or the monitoring entity, server 30) via the antenna ANT1. As the communication method, for example, LTE (Long Term Evolution), 5G (5th Generation mobile communication system), LPWA (LoRaWAN, Sigfox, NB-IoT, etc.), Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), etc. can be used.

[0018] The GPS receiving unit 104 receives radio waves from a plurality of GPS satellites via the GPS antenna ANT2 and calculates position information (latitude, longitude, altitude, etc.) indicating its current position.

[0019] The output unit 105 includes a speaker or buzzer for generating sound, a vibrator for generating vibration, and an LED (Light Emitting Diode) indicator or small display for indicating the status. In this embodiment, the speaker, in particular, outputs alarm sounds, notification sounds, voice messages, etc., at a volume level controlled by the volume control unit described later (broadly speaking, an auditory warning level including specific acoustic characteristics). It may also have a function to inform the user of the selected volume level or operating mode through the color or flashing pattern of the LED or a display.

[0020] The input unit 106 is an interface for receiving operational input from user U, and includes, for example, a physical pull-cord switch or push button for activating an alarm, or another form of physical switch such as a slide switch or toggle switch located on the side of the device that the user can operate in an emergency to activate an alarm, a power button, a microphone, etc. The microphone is used to collect ambient sounds, especially the voice of user U (such as screams or specific keywords).

[0021] The sensor unit 107 includes various sensors for detecting the state of the monitoring terminal 10 and the surrounding environment. In this embodiment, it includes at least a 3-axis accelerometer to detect the movement, impact, change in posture of the monitoring terminal 10, and the activity status of the user U (e.g., falling, dropping, discarding). In addition, it may include a gyroscope, illuminance sensor, temperature sensor, etc.

[0022] The power supply unit 108 consists of a battery (e.g., a lithium-ion battery) and a power management circuit, and supplies operating power to each part of the monitoring terminal 10.

[0023] (Appearance and operation example of the monitoring device) Figure 8 is a perspective view showing the external appearance and schematic of the alarm activation mechanism of the monitoring terminal 10 according to this embodiment. The monitoring terminal 10 has a compact GPS terminal body (housing) 10a suitable for portability. A display 105b is arranged on the surface of the GPS terminal body 10a as a display unit. This display 105b may be, for example, an LED indicator to show the power status, GPS reception status, notification status, etc., or a small segment display or organic EL display that displays simple icons. A pull cord 106b extends from the GPS terminal body 10a for the user to pull in an emergency, and a ring or tag that is easy for the user to grasp is attached to the end of the cord. When the user pulls the pull cord 106b in the direction of arrow (A), a pull cord switch mechanism (not shown, part of the input unit 106) provided inside the GPS terminal body 10a is activated. In response to the activation of this switch mechanism, an alarm sound or notification sound is generated from the speaker unit 105a included in the output unit 105 as shown by arrow (B), based on instructions from the volume control unit 409 (see Figure 4). Furthermore, although not shown in the diagram, the GPS terminal body 10a is equipped with a microphone along with the speaker unit 105a. Thus, this monitoring terminal has a configuration that allows the alarm to be activated intuitively through physical operation.

[0024] Next, an example of the hardware configuration of the monitoring terminal 20 (or monitoring entity in a broad sense) will be described. Figure 3 is a block diagram showing an example of the hardware configuration when the monitoring terminal 20 is a physical device. The monitoring terminal 20 is an information processing device such as a smartphone, tablet, or personal computer. As shown in Figure 3, the monitoring terminal 20 includes a control unit 201, a storage unit 202, a communication unit 203, a GPS receiver 204, a display unit 205, an input unit 206, and a speaker 207, a microphone 208, etc., which are interconnected via a system bus 209. Note that when the monitoring entity is implemented as a cloud service or web interface, its functions are executed on an information processing system such as a server 30 (Figure 1), and users access it via a general-purpose web browser or dedicated client software. In this case, the functions corresponding to the display unit 205 and input unit 206 are those of the PC or smartphone used by the user.

[0025] The control unit 201 consists of a CPU and other components, and controls the operation of the entire monitoring terminal 20 by executing dedicated application programs stored in the memory unit 202. The memory unit 202 consists of ROM, RAM, flash memory, etc. The communication unit 203 is equipped with communication interfaces such as wireless LAN and mobile phone networks, and communicates with the monitoring terminal 10 and server 30 via the network NW. The GPS receiver 204 acquires its own location information. The display unit 205 is a liquid crystal display or organic EL display, etc., and displays map information, the location of the monitoring terminal 10, various setting screens, and information regarding selected volume levels and operating conditions notified from the monitoring terminal. The input unit 206 is a touch panel integrated with the display unit 205, or physical buttons, etc., and receives operation input from the guardian P (for example, instructions to set / change the alarm level of the monitoring terminal in real time, or requests to display log data). The speaker 207 and microphone 208 are used for voice calls, output of notification sounds, voice input, etc.

[0026] (Explanation of functional block configuration) Next, the main functional blocks of the monitoring terminal 10 in this embodiment will be described. Figure 4 is a functional block diagram of the monitoring terminal 10. Functionally, the monitoring terminal 10 functions as a location information acquisition unit 401, an operation input reception unit 402, a voice input unit 403, a sensor information acquisition unit 404, a communication control unit 405, a memory control unit 406, a timing unit 407, a state determination unit 408, and the volume control unit 409 and output execution unit 410, which are the main components of this disclosure, through the cooperation of the program stored in the control unit 101 and the memory unit 102. The volume control unit 409 shown in Figure 4 may be composed of a plurality of sub-functional blocks (or software modules) that functionally cooperate with each other, such as a volume mode selection unit 409a (which includes a function to evaluate predetermined conditions and determine the volume level and sound mode) and a volume adjustment unit 409b (which includes a function to actually control the driving of the output unit 105 according to the determined volume level and mode). The important point is that these sub-function blocks work together or in coordination to achieve the overall function of the "volume control unit" as described in the claim (condition evaluation, level selection, output instruction and execution).

[0027] The location information acquisition unit 401 controls the GPS receiver unit 104 and periodically acquires location information indicating the current location of the monitoring terminal 10, or based on a predetermined trigger.

[0028] The operation input reception unit 402 monitors the operating status of pull-cord switches, push buttons, slide switches, etc., included in the input unit 106, and detects alarm activation operations (hereinafter also simply referred to as "activation operations") performed by user U.

[0029] The voice input unit 403 collects ambient sounds, particularly the voice of user U, via the microphone included in the input unit 106, and generates voice data.

[0030] The sensor information acquisition unit 404 acquires output signals from the sensor unit 107 (especially the acceleration sensor) and generates sensor information regarding the movement and impact of the monitoring terminal 10, and the physical condition of the user U (e.g., falls, dropping, discarding, etc.).

[0031] The communication control unit 405 controls the communication unit 103 and sends and receives location information, status information, setting information, alarm notifications, intervention commands, information regarding selected volume levels and operating conditions, log data, etc., to and from the monitoring terminal 20 (or monitoring entity, server 30).

[0032] The memory control unit 406 controls the reading and writing of various data to the memory unit 102 (particularly the non-volatile memory). For example, it stores and manages log data including area information (described later), user voiceprint feature data, various setting values, the selection history of volume level (or auditory warning level) by the volume control unit 409, the conditions that led to that selection, the output time, and the type of sound. This log data can be used for system operation analysis, feedback to the user, etc. Figure 15 shows an example of a specific table structure of the log data stored by the memory control unit 406 in this way. As shown in Figure 15, the log data table 1500 may consist of multiple log records 1510 including items such as timestamp 1501 at the time of each event occurrence, event type 1502 (e.g., "operation detected", "emergency condition met", "volume mode change", "test sound", etc.), selected volume level / mode 1503, summary of related sensor data 1504 (e.g., GPS location information, main values ​​of the accelerometer, keywords of the voice recognition result, etc.), battery level 1505, and communication status 1506. This makes it possible to track and analyze in detail the device's operation history and the circumstances surrounding the occurrence of specific warnings.

[0033] The timekeeping unit 407 measures the current date and time, as well as the elapsed time.

[0034] The state determination unit 408 comprehensively determines the situation in which user U and monitoring terminal 10 are located, based on various information obtained from location information acquisition unit 401, voice input unit 403, sensor information acquisition unit 404, etc., area information and settings read via memory control unit 406, and external information received from monitoring terminal 20 and server 30 via communication control unit 405 (e.g., AI analysis results, real-time instructions from guardians, etc.), and determines whether or not the "predetermined conditions" for selecting the volume level (or auditory warning level) that the volume control unit 409 should output are met. The "predetermined conditions" referred to here are not limited but may include a variety of forms such as (a) to (e) below. (a) Static conditions pre-configured on the monitoring device (e.g., specific sensor thresholds, entry into registered danger areas, time settings, etc.). (b) Conditions that the monitoring terminal autonomously determines based on sensor data, etc. (e.g., fall detection, scream detection, abnormal movement pattern, etc.). (c) Conditions based on instructions, commands, or data received from external devices such as monitoring terminals or servers (e.g., manual alarm instructions from a parent, risk level notifications from a server, etc.). (d) Conditions based on judgment criteria and predictive models that are dynamically generated or updated by the AI ​​(artificial intelligence) module of the monitoring terminal or a connected external device (server, etc.) through machine learning of past data, real-time sensor information, environmental information, etc. (e) Conditions that the user (e.g., parent) sets or customizes individually, either in real time or in advance, via a monitoring terminal or similar device.

[0035] Figure 9 is a block diagram showing the internal configuration and main information flow of the state determination unit 408 in more detail. As shown in Figure 9, the state determination unit 408 includes an area determination unit 408a, a voice recognition unit 408b, a behavior analysis unit 408c, a distance determination unit 408d, etc., which work together to process location information, voice information, sensor information, external information, etc. (exemplified as input information in the figure), and output the results (exemplified as output information in the figure) to the volume control unit 409, etc.

[0036] (State determination unit 408) (1) Area determination unit 408a: Determines whether the current location obtained from the location information acquisition unit 401 is within a specific area (e.g., dangerous area, safe area, geofenced area) pre-set in the memory unit 102, and also determines the type of that area (e.g., home, school, park, street, commercial facility, waterfront, etc.). (2) Speech recognition unit 408b: Performs speech recognition processing on the speech data obtained from the speech input unit 403 to detect specific keywords (e.g., "Help", "Danger") or acoustic characteristics (frequency, sound pressure pattern) unique to user U's screams. User U's voiceprint may be registered in advance and combined with voiceprint authentication to improve the accuracy of scream detection. (3) Behavior analysis unit 408c: Analyzes data patterns from acceleration sensors and other sensors obtained from the sensor information acquisition unit 404 to detect abnormal physical conditions of user U (e.g., sudden falls, dropping or discarding the terminal after operation, remaining motionless for a certain period of time or longer). It is also possible to use a behavior pattern recognition algorithm using machine learning. For example, the AI ​​module learns normal behavior patterns, dynamically evaluates the degree of deviation from those patterns, and determines that a specific "predetermined condition" has been met if the degree of deviation exceeds a threshold. (4) Distance determination unit 408d: Based on the communication status with the monitoring terminal 20 via the communication control unit 405 (e.g., Bluetooth signal strength, Wi-Fi connection status, or periodic communication check via the server 30), it estimates the relative distance between the monitoring terminal 10 and the monitoring terminal 20 and determines whether they are separated by a predetermined distance or more. This predetermined distance may be set variably according to the current location conditions determined by the area determination unit 408a (e.g., longer in a park with good visibility, shorter in a complex urban area).

[0037] The volume control unit 409 is the core functional unit of this disclosure. It comprehensively evaluates the detection of operation from the operation input receiving unit 402, the judgment results from the state determination unit 408 (including the determination of whether various "predetermined conditions" as detailed above are met or not), or information received from the monitoring terminal 20 (or monitoring entity) or server 30 via the communication control unit 405 (for example, the result of the situation judgment, the danger level, specific instruction commands, or recommended or instructed values ​​for the volume level or acoustic characteristics). Based on this, it determines and controls the volume level (or broad auditory warning level) of the sound output from the output unit 105.

[0038] Here, the "volume level" (or "auditory warning level") selected by the volume control unit 409 is not limited to merely the physical magnitude of sound pressure (decibels), but can be understood as a concept that also includes the actual auditory discrimination level that indicates the intensity and urgency of the warning perceived by the user. For example, even if the basic sound pressure level is the same, if the sounding pattern (e.g., intermittent or continuous, its period and duty cycle), timbre, rhythm, tempo, or the presence or type of a specific voice message is changed to convey different levels of warning or information to the user, then these acoustic outputs with different characteristics can be selected by the volume control unit 409 as corresponding to substantially different "volume levels" or "auditory warning levels."

[0039] Therefore, in this specification, when the volume control unit 409 “selects a volume level” (or “selects an auditory warning level”), it may include not only selecting the physical magnitude of sound pressure, but also a mode in which the intensity and identifiability of the warning conveyed to the user are gradually changed through such changes in the qualitative elements of sound. Furthermore, this act of “selection” includes not only the direct adjustment of volume parameters, but also the act of selecting one of several acoustic resources (for example, audio files with different recording levels and acoustic designs, synthesizer settings with specific parameter sets, etc.) that best suits the current “predetermined conditions” and outputting sound using that selected acoustic resource. In this case, the volume control unit is interpreted as indirectly and substantially selecting the desired “volume level” (or “auditory warning level”) through the selection of an acoustic resource. The important point is that even when information used for decision-making is provided from an external source, the volume control unit 409 of the monitoring terminal takes the lead in a series of processes, from evaluating that information as "predetermined conditions," identifying one level to be executed from among several types of volume levels (or auditory warning levels) that the monitoring terminal has pre-set or holds, to outputting sound from the output unit 105 at that level.

[0040] (Volume control unit 409) (Volume mode selection section 409a) Figure 10 is a flowchart showing an example of the specific conditional judgment logic used by the volume mode selection unit 409a when selecting each volume mode, such as silent test mode, normal notification mode, and emergency alarm mode. As shown in Figure 10, the appropriate volume mode (silent test mode S1004, normal notification mode S1005, emergency alarm mode S1006) is selected through conditional branching, such as whether or not a test instruction is given from the monitoring terminal (step S1001), detection of operation (step S1002), and whether or not an emergency condition is met (step S1003). (1) Silent test mode: Selected in response to a test instruction from the monitoring terminal 20 or a specific operation (e.g., pressing and holding the power button and the operation button simultaneously). In this mode, a test sound is output at a very low volume (e.g., approximately 50 dB or less) that does not cause any significant disturbance to the surroundings. This test sound is not only quiet, but may also be, for example, a specific short confirmation pattern sound. (2) Normal notification mode: This is the mode that is initially selected when the operation input reception unit 402 detects an operation. In this mode, the volume (or auditory warning level) is based on the level of a mobile phone ringtone (e.g., a sound pressure of approximately 60dB to 70dB, or acoustic characteristics with equivalent attention-grabbing power), and is automatically fine-tuned within a range that does not cause inconvenience, based on the geographical conditions of the current location determined by the area determination unit 408a (e.g., quieter in quiet places, and slightly louder in noisy places to be audible) (e.g., corresponding to Appendix 6). The sound output in this mode may be a specific warning tone or a short, intermittent beep, or any other sounding pattern that can attract attention without causing excessive tension to the user, and these essentially constitute the first volume level (or first auditory warning level). For example, selecting and playing one of several "normal notification audio files" depending on the situation may also be included in this mode. (3) Emergency alarm mode: This mode is selected when the status determination unit 408 determines that specific emergency conditions have been met during the initial sounding in normal notification mode (e.g., when the combined conditions in Appendix 2 are met), or when there is a direct instruction from the monitoring terminal 20 to activate the emergency alarm. In this mode, an alarm sound is output at a very loud volume (e.g., a sound pressure of approximately 90 dB or more, or equivalent highly urgent acoustic characteristics) comparable to that of a conventional security buzzer. The sound output in this mode does not simply increase the sound pressure level, but can also be, for example, a longer, continuous warning sound, a tone that emphasizes specific frequency components to strongly attract the user's attention, or a sound accompanied by a synthesized voice message such as "It is an emergency," which effectively constitute a second volume level (or a second auditory warning level). For example, selecting and playing one of several "emergency alarm voice files" according to the severity of the situation may also be included in this mode. Thus, changing the sounding pattern, timbre, or even the selected sound source itself can be considered a form of transition from a "first volume level" to a "second volume level," or a selection of a different "volume level" (or "auditory warning level").

[0041] (Volume control section 409b) Based on the selected volume mode or specific volume level instruction (or selected sound resource), the drive circuit of the output unit 105 (speaker) is controlled to adjust the output so that the sound is actually output at that volume and with those sound characteristics (pattern, timbre, etc.).

[0042] The output execution unit 410 drives the output unit 105 (speaker, vibrator, LED, display 105b, etc.) according to the volume level (or auditory warning level) and type of sound (including alarm sounds, notification sounds, voice messages, specific ringing patterns or tones, or selected acoustic resources) determined by the volume control unit 409, and actually outputs sound, vibration, light display, etc.

[0043] In particular, when the volume control unit 409 selects a specific volume level (or auditory warning level), it is effective to change not only the audio output from the speaker, but also the vibration characteristics of the vibrator (e.g., vibration intensity, vibration pattern, presence or absence of vibration), the light display characteristics of the LED (e.g., color, flashing pattern), and the content displayed on the display 105b (e.g., icon or text indicating the selected level) in conjunction with the selected level. For example, when a first auditory warning level is selected, a relatively quiet sound, weak intermittent vibrations for attention, and a specific LED display are output, and when a second auditory warning level is selected, a loud sound to alert the user and surroundings of danger, strong continuous warning vibrations, and different LED displays or display displays are output, allowing the user to more clearly recognize the urgency of the situation through multiple senses. Even when providing such multi-layered notifications, one of the important features of this disclosure is that the "sound volume level" (or actual auditory warning level) itself is selected and controlled from multiple types (along with the sound pattern and timbre as needed) based on predetermined conditions. Information regarding the selected volume level, operating mode, or the conditions that led to their selection may be notified to the monitoring terminal 20 (monitoring entity) via the communication control unit 405, where it may be displayed and recorded.

[0044] (Explanation of data structure) Next, we will describe an example of the main data structure used in this embodiment. Figure 6 shows an example of a geofence information data structure 600 that can be configured by a guardian using the application on the monitoring terminal 20.

[0045] The geofence information table 600 contains one or more geofence records 610. Each geofence record 610 has fields such as geofence ID 611, name 612, range information 613, area type 614, initial volume tendency 615, hazard location flag 616, and distance threshold 617. The geofence ID 611 is an ID that uniquely identifies each geofence. The name 612 is the name of the geofence set by the guardian (e.g., "Home", "A Elementary School District", "Shopping Street in front of the Station"). The range information 613 is information that defines the geographical range of the geofence (e.g., latitude and longitude of the center point and radius, or a set of vertex coordinates of a polygon). The area type 614 is information that indicates what kind of location the geofence is (e.g., "Home", "School", "Park", "Commercial Facility", "Danger", "Caution", etc.). The initial volume tendency 615 specifies the relative tendency of the initial volume when normal notification mode is activated within that geofence (e.g., "lower", "normal", "louder"). The hazardous location flag 616 is a flag (True / False) indicating whether the geofence falls under the "hazardous location" condition for transitioning to emergency alarm mode. The distance threshold 617 is a specific threshold (in meters, etc.) for the "predetermined distance" used to determine the distance from the monitoring terminal 20 within that geofence.

[0046] This information is transmitted from the monitoring terminal 20 to the monitoring terminal 10 and stored in the storage unit 102. The area determination unit 408a performs area determination by referring to this geofence information table 600. In addition to this setting information, the storage unit 102 may also store the operation log of the volume control unit 409 (for example, a log data table recording the detected conditions, selected volume level, output time, etc., see Figure 15).

[0047] (Explanation of the processing flow) Next, the main flow of the volume control process of the monitoring terminal 10 in this embodiment will be explained with reference to the flowchart in Figure 5. This process is achieved when the control unit 101 of the monitoring terminal 10 reads a program from the storage unit 102 and executes it.

[0048] First, the monitoring terminal 10 is in a standby state (step S501). In this standby state, the operation input receiving unit 402 determines whether or not it has detected an operation by the user U (e.g., pulling a string, pressing a button, issuing a specific voice command) (step S502). If no operation is detected (S502: NO), the standby state continues.

[0049] If an operation is detected (S502: YES), the volume control unit 409 first selects "normal notification mode" and causes the output execution unit 410 to emit an initial notification sound from the output unit 105 at an initial volume (or initial auditory warning level) adjusted according to the geographical situation of the current location determined by the area determination unit 408a (for example, based on the area type 614 and initial volume tendency 615 in the geofence information table 600 in Figure 6) and the initial severity of the situation evaluated by the status determination unit 408 (step S503). This initial notification sound is at a volume that will draw the attention of the user and those nearby while minimizing nuisance to the surroundings, and is output as a first volume level (or first auditory warning level) characterized by sound characteristics, such as a specific gentle chime or a short, intermittent beep. At the same time, notification by a first tactile pattern (e.g., short vibration) or status display by an LED may also be provided. Furthermore, this initial notification may be logged by the memory control unit 406 along with related information (time, location, type of detected operation, etc.). Figure 11 is a sequence diagram showing a specific example in normal notification mode in which the volume of the initial notification sound is adjusted according to the geographical location of the monitoring terminal 10. As shown in Figure 11, when user U operates the monitoring terminal 10 (M1101), the operation input reception unit 402 detects this (M1102), and the area determination unit 408a determines the area type and initial volume tendency based on current location information (e.g., geofence information) (M1103). The volume mode selection unit 409a selects normal notification mode (M1104), the volume adjustment unit 409b adjusts the volume according to the initial volume tendency of the determined area (e.g., "lower" for "library area", "normal" for "street area") (M1105), and the output execution unit 410 plays the initial notification sound from the speaker at that volume (M1106).

[0050] Next, the status determination unit 408 determines whether a predetermined emergency condition has been met (step S504). This emergency condition is, for example, a composite condition, namely, "(GPS location information corresponds to a pre-set "dangerous place" OR the microphone detects the user's "scream" or a specific keyword) AND (the acceleration sensor detects an "abnormal state" (e.g., fall, drop, discarding) OR the monitoring terminal is determined to be "a predetermined distance or more" away from the monitoring terminal)." Figure 12 is a conceptual diagram showing an example of the determination logic for such a composite "predetermined emergency condition." As shown in Figure 12, for example, if either condition group A (GPS location is within a "dangerous area" or the microphone detects a "scream") is met, AND either condition group B (the acceleration sensor detects an "abnormal state" or the monitoring terminal is "a predetermined distance or more" away from the monitoring terminal) is met, then it is determined that the "emergency condition has been met" overall. This makes it possible to increase the reliability of danger detection while suppressing false alarms by combining multiple circumstantial evidence rather than just a single condition. Furthermore, the determination of whether these "predetermined emergency conditions" have been met does not have to be based solely on autonomous sensor information from the monitoring terminal. For example, the system may also include a configuration in which, after sounding an initial notification tone in step S503 and notifying the monitoring terminal (monitoring entity) of the situation, the receipt of an instruction to raise the alarm level from the monitoring terminal is treated as part or all of the "predetermined emergency conditions," and the system determines that an emergency state has been reached upon receipt of such instruction. Additionally, the system may include a configuration in which the state determination unit 408 includes an AI module that learns and analyzes the degree of deviation from the user's normal behavior patterns and voice patterns in real time, and dynamically determines that an emergency condition has been met when the degree of deviation exceeds a predetermined threshold.

[0051] If it is determined that an emergency condition has been met (S504: YES), the volume control unit 409 selects "emergency alarm mode" and causes the output execution unit 410 to emit a loud emergency alarm sound (or a highly urgent auditory warning) from the output unit 105 (step S505). This emergency alarm sound is output as a second volume level (or second auditory warning level) different from the first volume level (or first auditory warning level), for example, as a longer, more continuous warning sound, a tone that emphasizes specific frequency components to strongly attract the user's attention, or a sound accompanied by a specific synthesized voice message such as "It's an emergency. We need help." At the same time, notification by a second tactile pattern (e.g., a long, strong SOS pattern vibration), flashing of an LED in a warning color, or a warning display on the display may also be provided, thereby realizing a gradual warning using sound, vibration, and light. The important point is that, even in such multiple notifications, the volume level of the sound (or the actual auditory warning level) itself is selected and changed from the first level to the second level based on predetermined conditions. Simultaneously, a notification of the occurrence of an emergency (including location information, time of occurrence, detected conditions, selected alarm level, etc.) is sent to the monitoring terminal 20 (monitoring entity) and / or the server 30 via the communication control unit 405 (step S506). This information may also be logged by the memory control unit 406. After that, the process ends (or it switches to a mode such as continuing the alarm until instructed by the guardian).

[0052] (Variations of volume control: continuous or multi-stage control) In the embodiments described above, the volume control unit 409 mainly described an embodiment in which it selects one of a plurality of predefined discrete volume levels (e.g., a first volume level, a second volume level), but this disclosure is not limited thereto. For example, the volume control unit 409 may continuously or in a number of fine steps that humans do not perceive as discrete, based on continuous or very multi-step parameters (e.g., a risk score that fluctuates between 0.0 and 1.0, or a multi-step warning index obtained by integrating information from multiple sensors) that indicate the user's situation and degree of danger, which are input from the state determination unit 408 or the like, to vary the volume (sound pressure) of the sound output from the output unit 105, or its acoustic characteristics (a broad auditory warning level including sounding pattern, timbre, tempo, etc.), according to a predetermined relationship (e.g., a direct proportional relationship, a logarithmic relationship, or a relationship based on a pre-set function) with the parameters.

[0053] Even when performing continuous or fine multi-stage control in this manner, within the control range, multiple "effective warning regions" or "substantial warning states" (for example, a calm state that the user perceives as "no abnormality," a state that the user perceives as merely a "warning," a "mild warning" state, a "moderate warning" state, and a strong warning state that the user perceives as an "emergency") can be set. The volume control unit 409 will output an auditory warning substantially corresponding to each of these effective warning regions when the parameter changes to a value corresponding to that region.

[0054] Therefore, even when the sound output level changes continuously, the volume control unit 409 controlling the system to achieve an acoustic output corresponding to one of several warning states that the user can identify, based on the parameters (predetermined conditions), can be understood as being within the scope of the technical idea of ​​"selecting and outputting one volume level from among several types of volume levels" as intended by this disclosure, or as an equivalent embodiment. The important functional effect is that multiple distinct levels of audibly identifiable warnings are provided in response to changes in conditions indicating the user's situation.

[0055] On the other hand, if it is determined in step S504 that the emergency condition is not met (S504: NO), the initial notification sound will continue for a certain period of time (for example, several seconds to tens of seconds, which can vary depending on the setting) and then automatically stop (step S507), or continue until a stop command is given remotely from the monitoring terminal 20. In this case, it is determined that there is a high possibility that it is a prank or a mistake, and the system will not transition to emergency alarm mode. After that, the process ends and the system returns to standby mode.

[0056] In addition to the above flow, if "Silent Test Mode" is activated by an instruction from the monitoring terminal 20, the volume control unit 409 will output a test sound at a very low volume. Furthermore, if a real-time intervention command (e.g., immediate emergency alarm activation, audio playback of a specific message) is received from the monitoring terminal 20, the volume control unit 409 will control the output unit 105 according to the instruction (e.g., corresponding to Appendix 11). Figure 14 is a sequence diagram showing an example of the processing flow when such an intervention command (e.g., a command corresponding to Appendix 11) is received from the monitoring terminal 20. When parent P operates the monitoring terminal 20 and sends, for example, an emergency alarm activation command to immediately maximize the volume level, or a command to play a specific audio message (e.g., "Come back immediately") to the monitoring terminal 10 (M1401), the communication control unit 405 of the monitoring terminal 10 receives this (M1402), and the volume control unit 409 interprets the command content (M1403). The volume control unit 409 directly sets the volume level or selects a specified voice message according to the instructions (M1404), and the output execution unit 410 drives the output unit 105 to output the instructed sound or message (M1405). This enables active situational intervention by the guardian.

[0057] This disclosure will also contribute to improving computer functionality and user interfaces. The control unit 101 (including the state determination unit 408 and the volume control unit 409) in the monitoring terminal 10 acquires and analyzes various stream data and event information in real time, such as GPS location information, voice information from the microphone, sensor information from the accelerometer, external instructions, and AI analysis results. It then comprehensively evaluates these to autonomously or collaboratively determine and control the volume level (or auditory warning level). This series of processes must be executed efficiently within limited computing resources and battery capacity, and efforts are made to reduce the processing load at the algorithm level and to save power by dynamically adjusting the sampling rate and processing frequency of sensor data. For example, in voice recognition processing, instead of performing full-spec recognition at all times, the sensitivity and processing accuracy of voice recognition are increased only when the accelerometer detects abnormal movement, thus enabling efficient data processing through sensor fusion. Furthermore, the matching process between location information and area information (geofencing, etc.) is also improved in real time by using algorithms that utilize efficient spatial indexes. Furthermore, the function to record and manage the selection history of volume levels and operating conditions as logs (see Figure 15) enhances the efficiency of data management and retrieval, as well as the auditability of the system. These processes substantially improve the computer capabilities of the small monitoring device and the entire monitoring system that includes it.

[0058] Furthermore, sensitive data collected by the monitoring terminal 10, such as location information, voice information, user behavior patterns, and log data, are encrypted when transmitted via the communication unit 103 or stored in the storage unit 102, thus ensuring improved data robustness (security).

[0059] The dedicated application or web interface running on the monitoring terminal 20 (or the monitoring entity's interface) has been improved to allow the guardian P to intuitively and easily perform various settings and status checks (e.g., viewing log data, checking the current warning level of the monitoring terminal). Figure 7 is a screen transition diagram showing an example of the user interface (UI) of the monitoring terminal 20. For example, from the main screen 701, it is possible to transition to the map display screen 702, the geofence settings screen 703, the notification history screen 704 (including operation logs, warning level history, and log data as shown in Figure 15), and various settings screens 705. On the map display screen 702, the current location of the monitoring terminal 10 is displayed on the map in real time, and the selected warning level may be indicated by an icon, making it easy to visually grasp the situation. On the geofence settings screen 703, the guardian P can easily create and edit geofence areas by intuitively tapping and dragging on the map (corresponding to the data structure in Figure 6), reducing the input burden on the user. Furthermore, the ability to configure the type of area and volume tendencies using easy-to-understand icons and options helps prevent accidental operation. When an emergency notification occurs, a warning is displayed on the main screen 701 and the map display screen 702, along with pop-up and push notifications, improving visibility. Real-time intervention functions (for example, a button to manually activate emergency alert mode, see Figure 14) are also placed in a location that allows for quick access in emergencies. These UI designs significantly contribute to improved usability.

[0060] In this embodiment, a configuration in which the monitoring terminal 10 performs the main judgment processing and selects the volume level (or auditory warning level) has been mainly described, but this disclosure is not limited thereto. For example, a configuration in which the server 30 performs situational judgment using more advanced AI (artificial intelligence) (e.g., more complex voice analysis, machine learning of behavioral patterns, risk prediction by integrating information from multiple monitoring terminals, personalized conditional judgment based on user profiles and past history, etc.) and transmits the judgment results (e.g., risk level "high," "medium," "low," situation category "fall," "possibility of getting lost," etc., or specific recommended volume levels and sound patterns, and even instructions on which acoustic resources to select, etc.) to the monitoring terminal 10 is also possible (see Figure 13).

[0061] In this case, the volume control unit 409 of the monitoring terminal 10 uses the received judgment result and recommended / instructed values ​​as an important part of the "predetermined conditions," and proactively "selects" one level (or resource) from among multiple volume levels (or auditory warning levels, or a library of acoustic resources) that are pre-associated or internally held, and outputs sound from the output unit 105. For example, if the server receives a result of "high risk," the volume control unit 409 selects the corresponding volume level (or acoustic resource) based on its own volume level settings (e.g., if high risk, the second volume level, a specific warning pattern, or a specific emergency audio file). Furthermore, if a specific volume level (e.g., "Output sound pattern X at 90dB") is directly instructed from a server or the like, the volume control unit of the monitoring terminal may accept that instruction as a "predetermined condition" and output sound at the instructed volume level and sound characteristics. This is also included within the scope of this disclosure as an action in which the volume control unit "selects" a volume level (or acoustic resource) based on that instruction (i.e., identifies the instructed level and characteristics as the target for execution) and performs the action.

[0062] Thus, even when an external device handles the main part of the situation assessment, the volume control unit of the monitoring terminal is responsible for selecting the final volume level (or auditory warning level) and controlling the output based on the "predetermined conditions" of the assessment result. Therefore, it is possible to implement this within the framework of this disclosure while enjoying benefits such as distribution of the processing load on the server 30 and improvement of safety assurance functions through more sophisticated judgment.

[0063] <Summary> [General tasks] One of the objectives of the present invention is to provide a highly convenient monitoring technology that balances user safety with the impact of the alarm device on the surrounding environment. Issues corresponding to [Appendix 1] One of the objectives of the present invention is to provide a monitoring system that can reduce the nuisance caused to the surroundings by alarm sounds while ensuring the safety of the user. [Note 1] A monitoring system comprising a monitoring device carried by the user and a surveillance device, The aforementioned monitoring terminal is The output section that outputs sound, A volume control unit that controls the volume of sound output from the output unit, Equipped with, The volume control unit, From among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, one volume level is selected based on predetermined conditions. The output unit outputs sound at the selected volume level. A monitoring system. According to the above monitoring system, by issuing alarms and notifications at appropriate volume levels according to the user's situation, it is possible to avoid causing nuisance with unnecessary loud noises while reliably issuing warnings in truly dangerous situations, thereby achieving both user safety and improved social acceptance.

[0064] Issues corresponding to [Appendix 2] One of the objectives of the present invention is to strengthen emergency response while suppressing false alarms by more accurately determining specific dangerous situations and appropriately escalating the alarm level. [Note 2] The volume control unit has, as the plurality of volume levels, a first volume level for outputting an initial sound in response to user operation, and a second volume level for outputting a sound louder than the initial sound when danger is detected. The aforementioned predetermined conditions are: (At least one of the following conditions is met: the current location of the monitoring terminal is within a pre-set danger area, or the microphone installed in the monitoring terminal has detected the user's scream, and, (At least one of the following conditions is met: the accelerometer installed in the monitoring terminal detects an abnormal physical condition of the user, or the monitoring terminal moves more than a predetermined distance away from the surveillance terminal.) This includes selecting the second volume level when the predetermined conditions are met. The monitoring system described in Appendix 1. This allows for a more reliable alarm system by determining urgency based on a combination of multiple sensor and location data, preventing pranks and excessive alarms in minor situations, while providing louder warnings for serious incidents.

[0065] Issues corresponding to [Appendix 3] One of the objectives of the present invention is to improve the accuracy of scream detection and to more reliably identify emergencies by recognizing user-specific voice characteristics and specific distress call phrases. [Note 3] The determination of whether the microphone has detected a user's scream is made based on matching it with a pre-registered user's voiceprint and / or recognizing a pre-set specific keyword. The monitoring system described in Appendix 2. This allows for the reduction of misidentification of mere noises or other people's voices by using voiceprint matching and keyword recognition, thereby improving responsiveness to genuine danger signals emitted by the user.

[0066] Issues corresponding to [Appendix 4] One of the objectives of this invention is to detect specific dangerous behaviors or highly urgent events, such as users falling or discarding devices, using an acceleration sensor, and to trigger a rapid alarm. [Note 4] The determination of whether the acceleration sensor has detected an abnormal physical condition of the user is made based on the detection of an acceleration pattern indicating the user falling, or the dropping or discarding of the monitoring terminal after the monitoring terminal has been activated. The monitoring system described in Appendix 2 or 3. This allows the system to detect situations such as a user falling or dropping or discarding the device to call for help, based on acceleration patterns. This enables the system to sense danger and issue an alarm even in situations where the user is unable to speak.

[0067] Issues corresponding to [Appendix 5] One of the objectives of the present invention is to dynamically change the threshold distance between the monitoring terminal and the surveillance terminal according to the user's current location, thereby setting an appropriate monitoring distance in various environments. [Note 5] The predetermined distance is set variably according to the current location of the monitoring terminal. The monitoring system described in Appendix 2, 3, or 4. This allows for flexible distance determination depending on the situation; for example, in areas with poor visibility, even a slight distance from the monitoring terminal can be deemed dangerous, while in open areas, a certain distance can be tolerated. This enhances the effectiveness of monitoring.

[0068] Issues corresponding to [Appendix 6] One of the objectives of this invention is to provide warnings without causing unnecessary nuisance by adjusting the initial notification volume when the monitoring terminal is activated, taking into consideration the surrounding environment. [Note 6] When the operation of the monitoring terminal is detected, the volume control unit first outputs sound at the first volume level. The aforementioned first volume level is a volume level adjusted to avoid causing nuisance, based on the geographical location of the monitoring terminal. The monitoring system described in Appendix 1 or 2. This allows for a balance between consideration for others and reliable notification by adjusting the initial notification volume according to geographical conditions, such as setting a lower initial volume in quiet places like libraries and a volume that can be heard on noisy streets.

[0069] Issues corresponding to [Appendix 7] One of the objectives of this invention is to provide multiple volume levels corresponding to different situations such as terminal operation confirmation, initial notification, and emergency alarm, thereby enabling fine-tuned volume control tailored to various usage scenarios. [Note 7] The aforementioned multiple types of volume levels are, A third volume level that does not substantially disturb the surroundings, for the user to check the operation of the aforementioned monitoring device, The first volume level, which is initially output when the operation of the monitoring terminal is detected and is adjusted based on the geographical location of the monitoring terminal, A second volume level, which is greater than the first volume level, is output when a predetermined emergency condition is met. including, The monitoring system described in Appendix 1, 2, or 6. This allows for the setting of gradual volume levels—a very low volume for testing without disturbing others, an initial notification volume that adjusts according to the situation, and a loud volume that reliably alerts to danger in emergencies—to comprehensively enhance user convenience and safety.

[0070] Issues corresponding to [Appendix 8] One of the objectives of this invention is to enable parents to customize volume rules and risk level settings for specific geographical areas, thereby achieving more personalized monitoring. [Note 8] The monitoring terminal includes a setting unit for a guardian to set a geographic area on a map and to associate with the set geographic area at least one of the following: rules regarding the volume level of sound output by the monitoring terminal, designation as a dangerous place under the predetermined conditions for selecting the second volume level, or a predetermined distance threshold. The volume control unit of the monitoring terminal selects the volume level based on the associated rule, designation, or threshold when the current location of the monitoring terminal is within the set geographical area. A monitoring system as described in any one of the following appendices: 1, 2, 6, or 7. This allows parents to set geofences around their homes, school routes, and areas where danger is anticipated, and pre-define volume control rules for each area (initial volume tendencies, designation of dangerous locations that trigger emergency alarm mode, and acceptable distance from monitoring terminals), enabling more detailed and practical monitoring.

[0071] Issues corresponding to [Appendix 9] One of the objectives of the present invention is to clarify the priority when system default area information and parental control area information conflict, so that the intended settings are applied. [Note 9] If area information is pre-configured in the system, and the current location of the monitoring terminal falls within both the geographic area set by the guardian and the area information, the rules, designations, or thresholds associated with the geographic area set by the guardian shall take precedence. The monitoring system described in Appendix 8. This prioritizes individual settings made by parents over general system-wide settings, enabling volume control that more accurately reflects the user's specific situation and the parents' intentions, thereby increasing the flexibility and reliability of the settings.

[0072] Issues corresponding to [Appendix 10] One of the objectives of the present invention is to enable guardians to quickly understand the situation and take action by notifying a monitoring terminal of information when a monitoring terminal approaches or enters a dangerous area. [Note 10] The system further includes a notification unit that notifies the monitoring terminal if it detects that the current location of the monitoring terminal has approached or entered an area that has been pre-designated as a dangerous location. A monitoring system as described in any one of the following appendices: 1, 2, 6, 7, 8, or 9. This allows for alerts to be sent to parents if the user unintentionally approaches a dangerous area, prompting them to take action to prevent accidents and troubles.

[0073] Issues corresponding to [Appendix 11] One of the objectives of the present invention is to provide a means of proactive intervention by enabling parents to remotely change the volume level of a monitoring device or play specific voice messages from a monitoring terminal. [Note 11] The monitoring terminal further includes an intervention unit that, in response to a notification from the notification unit or at the discretion of the guardian, transmits to the monitoring terminal a command to temporarily change the volume level selection by the volume control unit, or a command to output a specific voice message. The monitoring system described in Appendix 10. This allows for more proactive and flexible responses, for example, when notifications from the monitoring device are insufficient to assess the situation, or when a stronger warning is needed, parents can remotely raise the alarm level or give specific instructions (such as "contact us immediately") via voice.

[0074] Issues corresponding to [Appendix 12] One of the objectives of the present invention is to provide an information processing device that can reduce the nuisance caused to the surroundings by alarm sounds while ensuring the safety of the user. [Note 12] The output section that outputs sound, A volume control unit that controls the volume of sound output from the output unit, Equipped with, The volume control unit, From among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, one volume level is selected based on predetermined conditions. The output unit outputs sound at the selected volume level. Information processing device. According to the above-mentioned information processing device, by issuing alarms and notifications at an appropriate volume level according to the user's situation, it is possible to avoid causing nuisance with unnecessary loud noises while reliably issuing warnings in truly dangerous situations, thereby achieving both user safety and improved social acceptance.

[0075] Issues corresponding to [Appendix 13] One of the objectives of the present invention is to provide an information processing method that can reduce the nuisance caused to the surroundings by alarm sounds while ensuring the safety of the user. [Note 13] The processor, With respect to the sound output from the output unit of the monitoring terminal, the step of selecting one volume level from among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, based on predetermined conditions, The steps include: outputting sound from the output unit at the selected volume level; Execute Information processing methods. According to the information processing method described above, by issuing alarms and notifications at an appropriate volume level according to the user's situation, it is possible to avoid causing nuisance with unnecessary loud noises while reliably issuing warnings in truly dangerous situations, thereby achieving both user safety and improved social acceptance.

[0076] Issues corresponding to [Appendix 14] One of the objectives of the present invention is to provide a program that can reduce the nuisance caused to the surroundings by alarm sounds while ensuring the safety of the user. [Note 14] Computers, The output section that outputs sound, It functions as a volume control unit that controls the volume of the sound output from the output unit. The volume control unit, From among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, one volume level is selected based on predetermined conditions. The output unit outputs sound at the selected volume level. To execute the process program. According to the program described above, by providing alarms and notifications at appropriate volume levels according to the user's situation, it is possible to avoid nuisance caused by unnecessary loud noises while reliably issuing warnings in truly dangerous situations, thereby achieving both user safety and improved social acceptance. Elements of each embodiment may be combined as appropriate. [Explanation of Symbols]

[0077] 1. Monitoring System 10. Monitoring device 10a GPS terminal unit (housing) 20 monitoring terminals 30 servers 101 Control Unit (Processor) 102 Storage section 103 Communications Department 104 GPS receiver 105 Output section 105a Speaker section 105b Display 106 Input section 106b Pull cord 107 Sensor section 108 Power supply section 109 System Bus 201 Control Unit (Processor) 202 Storage section 203 Communications Department 204 GPS receiver 205 Display section 206 Input section 207 speakers 208 Mike 209 System Bus 401 Location information acquisition unit 402 Operation Input Reception Unit 403 Voice Input Section 404 Sensor Information Acquisition Unit 405 Communication Control Unit 406 Memory Control Unit 407 Timing section 408 State determination unit 408a Area determination unit 408b Speech Recognition Unit 408c Behavior Analysis Department 408d Distance judgment section 409 Volume control unit 409a Volume Mode Selection Section 409b Volume control section 410 Output Execution Unit 600 Geofence Information Table 610 Geofence Records 611 Geofence ID 612 Name 613 Range Information 614 Area Types 615 Initial volume tendency 616 Dangerous Location Flag 617 Distance threshold 701 Main screen 702 Map display screen 703 Geofence settings screen 704 Notification History Screen 705 Various setting screens ANT1, ANT2 antennas NW Network P guardian U User Steps S501-S507 in the flowchart Steps S1001-S1006 in the flowchart (Figure 10) Messages in the sequence diagram (Figure 11) for M1101~M1106 Messages in the sequence diagram (Figure 13) for M1301~M1307 Messages in the sequence diagram (Figure 14) for M1401~M1405 1500 Log Data Table 1501 Timestamp 1502 Event Type 1503 Selected volume level / mode 1504 Summary of related sensor data 1505 Battery remaining 1506 Communication status 1510 Log Records

Claims

1. A monitoring system comprising a monitoring device carried by the user and a surveillance device, The aforementioned monitoring terminal is The output section that outputs sound, A volume control unit that controls the volume of sound output from the output unit, Equipped with, The volume control unit, From among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, one volume level is selected based on predetermined conditions. The output unit outputs sound at the selected volume level. A monitoring system.

2. The volume control unit has, as the plurality of volume levels, a first volume level for outputting an initial sound in response to user operation, and a second volume level for outputting a sound louder than the initial sound when danger is detected. The aforementioned predetermined conditions are: (At least one of the following conditions is met: the current location of the monitoring terminal is within a pre-set danger area, or the microphone installed in the monitoring terminal has detected the user's scream, and, (At least one of the following conditions is met: the acceleration sensor installed in the monitoring terminal detects an abnormal physical condition of the user, or the monitoring terminal moves more than a predetermined distance away from the surveillance terminal.) This includes selecting the second volume level when the predetermined conditions are met. The monitoring system according to claim 1.

3. The determination of whether the microphone has detected a user's scream is made based on matching it with a pre-registered user's voiceprint and / or recognizing a pre-set specific keyword. The monitoring system according to claim 2.

4. The determination of whether the acceleration sensor has detected an abnormal physical condition of the user is made based on the detection of an acceleration pattern indicating the user falling, or the dropping or discarding of the monitoring terminal after the monitoring terminal has been activated. The monitoring system according to claim 2.

5. The predetermined distance is set variably according to the current location of the monitoring terminal. The monitoring system according to claim 2.

6. When the operation of the monitoring terminal is detected, the volume control unit first outputs sound at the first volume level. The aforementioned first volume level is a volume level adjusted to avoid causing nuisance, based on the geographical location of the monitoring terminal. The monitoring system according to claim 1 or 2.

7. The aforementioned multiple types of volume levels are, A third volume level that does not substantially disturb the surroundings, for the user to check the operation of the monitoring terminal, The first volume level, which is initially output when the operation of the monitoring terminal is detected and is adjusted based on the geographical location of the monitoring terminal, A second volume level, which is greater than the first volume level, is output when a predetermined emergency condition is met. including, The monitoring system according to claims 1 and 2.

8. The monitoring terminal includes a setting unit for a guardian to set a geographic area on a map and to associate with the set geographic area at least one of the following: rules regarding the volume level of sound output by the monitoring terminal, designation as a dangerous place under the predetermined conditions for selecting the second volume level, or a predetermined distance threshold. The volume control unit of the monitoring terminal selects the volume level based on the associated rule, designation, or threshold when the current location of the monitoring terminal is within the set geographical area. The monitoring system according to claim 1 or 2.

9. If area information is pre-configured in the system, and the current location of the monitoring terminal falls within both the geographic area set by the guardian and the area information, the rules, designations, or thresholds associated with the geographic area set by the guardian shall take precedence. The monitoring system according to claim 8.

10. The system further includes a notification unit that notifies the monitoring terminal if it detects that the current location of the monitoring terminal has approached or entered an area that has been pre-designated as a dangerous location. The monitoring system according to claim 1 or 2.

11. The monitoring terminal further includes an intervention unit that, in response to a notification from the notification unit or at the discretion of the guardian, transmits to the monitoring terminal a command to temporarily change the volume level selection by the volume control unit, or a command to output a specific voice message. The monitoring system according to claim 10.

12. The output section that outputs sound, A volume control unit that controls the volume of sound output from the output unit, Equipped with, The volume control unit, From among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, one volume level is selected based on predetermined conditions. The output unit outputs sound at the selected volume level. Information processing device.

13. The processor, With respect to the sound output from the output unit of the monitoring terminal, the step of selecting one volume level from among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, based on predetermined conditions, The steps include: outputting sound from the output unit at the selected volume level; Execute Information processing methods.

14. Computers, The output section that outputs sound, It functions as a volume control unit that controls the volume of the sound output from the output unit. The volume control unit, From among a plurality of volume levels, including at least a first volume level and a second volume level different from the first volume level, one volume level is selected based on predetermined conditions. The output unit outputs sound at the selected volume level. To execute the process program.

Images