Monitoring terminal, information processing method, program, and information processing system

Abstract

This enables a reduction in power consumption due to status display in a monitoring terminal equipped with a display. [Solution] A monitoring terminal is provided, comprising a communication unit for communicating with an external terminal, a display, a button unit for accepting user operations, a light-emitting element arranged in the area of ​​the button unit other than the display area of ​​the display, and a control unit for controlling the light emission of the light-emitting element according to the operating state of the device. The operating state includes a voice message reception state, a recording state, a shooting state, a dangerous area entry state, etc., and each is displayed with a different light emission pattern.

Description

Technical Field

[0001] The present invention relates to a monitored terminal, an information processing method, a program, and an information processing system.

Background Art

[0002] Conventionally, a monitored terminal that acquires a child's location information and notifies a guardian has been known (see Patent Document 1). In such a monitored terminal, various functions such as transmission and reception of voice messages, photography, and recording are installed, and there are some that display these operating states on a display screen to inform the user.

[0003] Also, in a mobile terminal such as a smartphone, a technique for lighting or blinking a single LED (notification LED) arranged on the front or back of the terminal to notify incoming calls and notifications is also known.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] One object of the present invention is to provide a monitored terminal, an information processing method, a program, and an information processing system that can visually display an operating state with low power consumption.

Means for Solving the Problems

[0006] One aspect of the present invention is a monitored terminal including a communication unit that communicates with an external terminal, a display, a button unit that receives a user operation, a light-emitting element arranged in a region other than the display region in the button unit, and a control unit that controls light emission of the light-emitting element according to an operating state of the device.

Effects of the Invention

[0007] According to one aspect of the present invention, the operating status can be visually displayed with low power consumption. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows the overall configuration of the monitoring system according to this embodiment. [Figure 2] This is a block diagram showing the hardware configuration of the monitored device. [Figure 3] This is a functional block diagram of the monitoring device. [Figure 4] This diagram (basic configuration) shows the external appearance of the monitored terminal and the gap structure between the button area and the housing. [Figure 5] This is a diagram showing the external configuration of the monitored terminal (with camera installed). [Figure 6] This figure shows an example of the first LED arrangement (single LED arrangement) in the button area. [Figure 7] This diagram shows an example of the arrangement of the second LED (multiple LEDs) in the button area. [Figure 8] This is a table diagram showing the correspondence between operating states and LED light emission patterns. [Figure 9] This is a flowchart showing the processing flow when a voice message is received. [Figure 10] This is a flowchart showing the processing flow when a dangerous area is detected. [Figure 11] This flowchart shows the detailed process for controlling the luminescence intensity. [Figure 12] This block shows the control mechanism linked to the ambient light sensor. [Figure 13] This is a time chart showing the time-series changes when multiple light emission patterns are combined. [Figure 14] This is an external view showing a modified camera arrangement. [Figure 15] UI diagrams showing screen display examples for various applications.

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0010] (Overall System Configuration) FIG. 1 is a diagram showing the overall configuration of the monitoring system according to the present embodiment. The monitoring system 1 includes a monitored terminal 10 carried by a child, a guardian terminal 20 used by a guardian, and a network 30 connecting these. The monitored terminal 10 acquires position information by means such as GPS and performs transmission and reception of voice messages with the guardian terminal 20. Further, the monitored terminal 10 has a photographing function by a camera and a recording function by a microphone.

[0011] (Hardware Configuration of Monitored Terminal) FIG. 2 is a diagram showing the hardware configuration of the monitored terminal 10. The monitored terminal 10 includes a processor 11, a memory 12, a storage 13, a communication interface 14, a display 15, a button unit 16, a light emitting element 17, a camera 18, a microphone 19, a speaker 21, a GPS receiver 22, and a bus 23 connecting these.

[0012] The processor 11 is a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or a combination thereof, and executes a program stored in the storage 13 to realize various functions of the monitored terminal 10. The memory 12 is a main storage device such as a RAM (Random Access Memory), and temporarily stores data when the program is executed by the processor 11. The storage 13 is a non-volatile storage device such as a ROM (Read Only Memory) or a flash memory, and permanently stores programs and various data.

[0013] In the hardware configuration shown in FIG. 2, the processor 11 functions as the central processing unit of the monitored terminal 10, the memory 12 is responsible for temporary data storage, and the storage 13 is responsible for permanent program and data storage. The communication interface 14 performs wireless communication with the external, the display 15 displays visual information, and the button unit 16 receives user operations. The light-emitting element 17, which is a feature of the present invention, is arranged at a position independent of the display area of the display 15 within the area of the button unit 16. The camera 18, the microphone 19, the speaker 21, and the GPS receiver 22 function as peripheral devices for realizing the monitoring function. These components perform data communication with each other via the bus 23. The inertial sensor 24 is an inertial measurement device including an acceleration sensor, a gyroscope, etc., and detects the posture, movement, vibration, etc. of the monitored terminal 10. It is also possible to detect the fall, violent movement, abnormal vibration, etc. of the terminal by the inertial sensor 24 and determine an emergency situation. The ambient light sensor 25 measures the surrounding lighting environment and is used to automatically adjust the light emission intensity of the light-emitting element 17 according to the environment.

[0014] The communication interface 14 communicates with the guardian terminal 20 via the network 30 by a communication method such as wireless LAN, LTE, etc. The display 15 is a liquid crystal display, an organic EL display, etc., and displays various information. The button unit 16 is a physical button that receives user operations, and operations such as starting the recording of a voice message can be performed by a pressing operation.

[0015] The light-emitting element 17 is a light-emitting device such as an LED (Light Emitting Diode), an organic EL (Organic Electro-Luminescence), an inorganic EL (Inorganic Electro-Luminescence), etc., and is arranged in an area other than the display area of the display 15 of the button unit 16. The light-emitting element 17 can be a single-color LED, a full-color LED, or a combination of a plurality of LEDs of different colors.

[0016] In this embodiment, the monitored terminal 10 is assumed to have two configurations: a basic configuration and an extended configuration. In the basic configuration, the core functions provided are location information acquisition, voice message transmission and reception, and status display (light-emitting element 17), but the camera 18 is not included. This configuration is suitable for providing basic monitoring functions at a low cost.

[0017] In the expanded configuration, a camera 18 is added to the basic configuration to provide photo / video messaging, monitoring photography, and various authentication and analysis functions. The camera 18 is an imaging device that captures still images and videos. The camera 18 can be used for a variety of purposes, such as sending photo and video messages, periodic monitoring photography, automatic photography in emergencies, reading information such as 2D codes, identity verification by facial recognition, emotion estimation by facial recognition, and recording the surrounding environment. Note that the camera 18 is not a mandatory configuration requirement and can be omitted depending on the application and cost requirements.

[0018] Microphone 19 is a sound-collecting device that records voice and is located on the lower part of the case of the button section 16. Microphone 19 is used for recording voice messages, monitoring ambient sounds, and controlling operations by voice recognition. In this embodiment, multiple microphones 19a and 19b can be provided to improve sound quality and control directionality, but it can also be implemented with a single microphone 19. When multiple microphones are used, beamforming technology can be used to focus on picking up sound from a specific direction.

[0019] The speaker 21 is an acoustic device that outputs audio such as received voice messages, and is positioned on the lower side of the case of the button section 16, similar to the microphone 19. The audio from the speaker 21 is output to the outside through a gap 24 provided between the case and the button section 16. This gap 24 is formed as a fine opening with a width of approximately 0.5 to 2.0 mm in order to optimize the acoustic characteristics. In this embodiment, multiple speakers 21a and 21b can be provided for stereo sound and echo cancellation functions, but it can also be implemented with a single speaker 21. The GPS receiver 22 receives signals from GPS satellites to acquire location information.

[0020] (Functional configuration of the monitored device) Figure 3 is a functional block diagram of the monitored terminal 10. The monitored terminal 10 includes a communication unit 31, a location information acquisition unit 32, a detection unit 33, a control unit 34, and a storage unit 35. These functional units are realized by the processor 11 executing a program stored in the storage 13.

[0021] The communication unit 31 controls the communication interface 14 to send and receive various data such as voice messages and location information with the guardian terminal 20. The location information acquisition unit 32 controls the GPS receiver 22 to receive signals from GPS satellites and acquire location information indicating the current location of the monitored terminal 10.

[0022] The detection unit 33 detects various operating states of the monitored terminal 10. In this embodiment, "operating state" refers to a state classified based on the process the monitored terminal 10 is currently executing or the circumstances in which the monitored terminal 10 is located, and specifically includes the following states: (1) Communication state: state of receiving a voice message from the guardian terminal 20 by the communication unit 31, state of transmitting location information, etc.; (2) Recording state: state of recording voice by the microphone 19; (3) Shooting state: state of shooting a still image or video by the camera 18; (4) Warning state: state of entering a pre-set danger area, low battery state, etc.; (5) Operation state: state of pressing the button unit 16. The danger area is pre-set by the guardian terminal 20 as an area other than safe places such as school or home.

[0023] These operating states occur automatically in conjunction with the execution of functions of the monitored terminal 10 and are not manually set by the user. Each operating state is detected by signals from the corresponding functional unit (communication unit 31, microphone 19, camera 18, etc.). The detection unit 33 continuously monitors the start, continuation, and end of these operating states and notifies the control unit 34 of any changes in state.

[0024] The control unit 34 controls the overall operation of the monitored terminal 10. In particular, the control unit 34 controls the illumination of the light-emitting element 17 according to the operating state detected by the detection unit 33. As illumination control, the control unit 34 can turn the light-emitting element 17 on, off, blink, change the illumination color, change the illumination intensity, etc. The storage unit 35 stores various data using the memory 12 and storage 13. The control unit 34 also performs light emission intensity control based on the signal from the ambient light sensor 25. In this control, the control unit 34 works in cooperation with the light intensity determination unit 36 ​​and the brightness control unit 37. The light intensity determination unit 36 ​​analyzes the ambient brightness measured by the ambient light sensor 25 and classifies it into three stages: high brightness (outdoors, sunny), medium brightness (indoors, cloudy), and low brightness (nighttime, darkroom). The brightness control unit 37 calculates the light emission intensity of the light-emitting element 17 based on the determination result of the light intensity determination unit 36 ​​and adjusts it to brightness levels of 100%, 50%, and 20%, respectively.

[0025] (External structure of the monitored device) Figure 4 is a basic configuration diagram showing the external configuration of the monitored terminal 10. The monitored terminal 10 has a roughly square housing 26, and a display 15 is located in the center of the housing 26. The display area of ​​the display 15 is clearly demarcated as a rectangular area (e.g., 30 mm x 24 mm) in the center of the housing 26. Below the display 15, a circular button section 16 is located. The button section 16 is configured as a pressable physical button, and most of its surface is a black movable part. The button section 16 is a physically separate and independent component from the display area of ​​the display 15. The area outside the boundary line B of the display area A of the display 15 all corresponds to area C other than the display area of ​​the display. The light-emitting element 17 is positioned within this area C. This enables light emission display that is independent of the display display.

[0026] A gap 24 with a width of 0.5 to 2.0 mm is provided between the button section 16 and the housing case 26. This gap 24 ensures the mobility of the button section 16 and also functions as an audio output path from the speaker 21 located inside. The microphones 19a and 19b and the speakers 21a and 21b are located in the lower part of the case of the button section 16, i.e., in the internal space of the gap 24.

[0027] Figure 4 shows the basic configuration without the camera 18. In this configuration, the main components are the display 15, button section 16, light-emitting element 17, and sound system (microphone 19, speaker 21). On the other hand, Figure 5 shows the expanded configuration with the camera 18. The camera 18 is positioned above or to the side of the display 15. The position of the camera 18 is optimized according to the shooting application. For example, it can be positioned at the top front when shooting a child's facial expressions, or on the side when shooting the surrounding environment. The GPS receiver 22, battery B, control circuit, etc., are housed inside the casing.

[0028] Figure 5 shows an expanded configuration with camera 18. Compared to the basic configuration (Figure 4), camera 18a is additionally positioned on the upper front of the housing 26, and camera 18b is additionally positioned on the side of the housing 26. Camera 18a may be used mainly for capturing children's facial expressions, and camera 18b may be used for capturing the surrounding environment. The camera placement is optimized according to the shooting purpose and is designed to not affect the placement or operation of the light-emitting element 17. The GPS receiver 22, battery B, control circuit, etc. are housed inside the housing 26.

[0029] (Arrangement configuration of light-emitting elements) Figures 6 and 7 show examples of the arrangement of light-emitting elements 17 in the button section 16. Figure 6 shows a first arrangement example, in which a single light-emitting element 17a is arranged on the outer periphery of the button section 16 on the display 15 side. This configuration is suitable for basic status display with a simple configuration. The light-emitting element 17a is arranged on the upper outer periphery of the button section 16, ensuring 360-degree visibility.

[0030] Figure 7 shows a second arrangement example, in which multiple light-emitting elements 17b, 17c, 17d, and 17e are arranged around the outer periphery of the button section 16. In this case, the type of operation status, urgency, etc., can be visually represented by the light-emitting positions of the light-emitting elements 17b to 17e. For example, the upper light-emitting element 17b can indicate voice reception, the right light-emitting element 17c can indicate recording status, the lower light-emitting element 17d can indicate shooting status, and the left light-emitting element 17e can indicate a dangerous state. By lighting up multiple light-emitting elements simultaneously, it is also possible to display a complex status.

[0031] The placement of the light-emitting element 17 may be in an area other than the display area of ​​the display 15, as long as it is in a position other than the arrangement shown in Figures 6 and 7. For example, the light-emitting element 17 may be embedded in the movable part 16a of the button part 16, or it may be placed on the outer casing of the button part 16. The important point is that the light-emitting element 17 is positioned independently of the display 15, and visual notifications can be made without using the display 15. In the first arrangement example shown in Figure 6, a single light-emitting element 17a is positioned on the upper outer circumference of the button portion 16, ensuring 360-degree visibility. This arrangement allows the illumination status to be confirmed regardless of the orientation of the terminal 10. In the second arrangement example shown in Figure 7, four light-emitting elements 17b, 17c, 17d, and 17e are arranged at equal intervals on the outer circumference of the button portion 16. In this configuration, the type of operation status, urgency, etc., can be visually represented by the position of each light-emitting element.

[0032] (Light emission control pattern) Figure 8 is a table showing the correspondence between operating states and light emission patterns. Based on this table, the control unit 34 controls the light emission of the light-emitting element 17 according to the detected operating state. The light emission patterns described below are examples and are not limited to them.

[0033] When a voice message is received, the light-emitting element 17 lights up blue. This lets the child know that a message from a parent or guardian has arrived. When recording, the light-emitting element 17 blinks red. This lets the child know that recording is currently in progress and clearly indicates the start and end of the recording.

[0034] When recording is in progress, the light-emitting element 17 flashes green. This informs the child and those around them that recording is currently in progress, encouraging privacy-conscious use. When entering a dangerous area, the light-emitting element 17 flashes red rapidly. This strongly warns the child that they are in a dangerous location.

[0035] When communication is in progress, the light-emitting element 17 flashes white. This indicates that location information is being transmitted or data communication is taking place. When the battery is low, the light-emitting element 17 flashes orange. This informs the child that charging is required.

[0036] The light emission patterns are not limited to those described above. By combining color, flashing interval, flashing pattern, light intensity, etc., a wider variety of information can be expressed. For example, by shortening the flashing interval in high-urgency situations and lengthening it in normal situations, a visual representation corresponding to the urgency can be achieved.

[0037] The light emission control table shown in Figure 8 defines specific combinations of operating states and corresponding light emission patterns. The light emission colors are selected based on color psychology to be intuitively understandable to the user. For example, blue is used to represent "information" and "safety," red to represent "caution" and "urgency," and green to represent "processing" and "normal operation." The flashing interval is set according to the degree of urgency, and a high-speed flashing of 0.2 seconds is used when entering a dangerous area to provide strong warning. This makes it possible to clearly distinguish between multiple operating states, which was not possible with conventional single-LED notifications.

[0038] Figure 13 is a time chart showing the time-series changes when multiple light emission patterns are combined. The horizontal axis represents time (seconds), and the vertical axis represents the light emission state in four stages, from off to high brightness. In the normal state from 0 to 2 seconds, the light-emitting element 17 remains off, and in the voice reception state from 2 to 4 seconds, it continuously lights up in blue (medium brightness). In the recording start state from 4 to 6 seconds, it switches to flashing red, and in the danger detection state from 6 to 8 seconds, it expresses the urgency by rapidly flashing red (high brightness). In the combined state from 8 to 10 seconds, an example of a combination of light emission patterns when both recording and communication states occur simultaneously is shown. In this way, it is possible to visually grasp the changes in the operating state of the monitored terminal 10 by observing the time-series changes in the light emission pattern.

[0039] (Action when receiving a voice message) Figure 9 is a flowchart showing the processing flow when a voice message is received. In step S101, the communication unit 31 receives a voice message from the parent terminal 20. In step S102, the detection unit 33 detects that a voice message has been received. In step S103, the control unit 34 lights up the light-emitting element 17 in blue.

[0040] In step S104, it is determined whether a press operation of the button 16 has been detected. If a press operation is detected, in step S105, the received voice message is output from the speaker 21, and in step S106, the light-emitting element 17 is turned off. If a press operation is not detected, in step S107, it is determined whether a predetermined time (e.g., 10 minutes) has elapsed, and if not, the process returns to step S104. If the predetermined time has elapsed, the light-emitting element 17 is turned off in step S106.

[0041] Thus, when a voice message is received, the light-emitting element 17 lights up to notify the child of the message's arrival, and playback can be started by pressing a button. Notification by light emission consumes less power compared to display and is also effective in environments where display use is restricted, such as schools. In the flowchart shown in Figure 9, each process from step S101 to S106 is executed by the coordinated operation of each functional unit within the monitored terminal 10. Specifically, the communication unit 31 is responsible for receiving the communication in step S101, the detection unit 33 for detecting the state in step S102, the control unit 34 for controlling the light emission in step S103, the control unit 34 and the button unit 16 for detecting the button operation in step S104, the speaker 21 for outputting the audio in step S105, and the control unit 34 and the light-emitting element 17 for turning the light off in step S106. In this way, the organic cooperation of each functional unit realizes a seamless processing flow from receiving the voice message to the completion of playback.

[0042] (Action taken when a dangerous area is detected) Figure 10 is a flowchart showing the processing flow when a dangerous area is detected. In step S201, the location information acquisition unit 32 acquires the current location information. In step S202, the detection unit 33 compares the acquired location information with the range of a pre-set dangerous area and determines whether entry into the dangerous area has been detected.

[0043] If entry into a dangerous area is detected, in step S203, the control unit 34 causes the light-emitting element 17 to flash red at high speed. In step S204, the communication unit 31 sends a notification of entry into a dangerous area to the parent terminal 20. In step S205, it is determined whether the current location has left the dangerous area, and if not, the process returns to step S203 and the light emission continues. If the location has left the dangerous area, the light-emitting element 17 is turned off in step S206.

[0044] The rapid red flashing that occurs when entering a dangerous area is a highly urgent indicator pattern that is clearly distinguishable from the normal operating status. This strongly warns children that they are in a dangerous place and encourages them to move to a safe location.

[0045] (modified version) Modifications of this embodiment will be described below.

[0046] (Variation 1: Directional indicator using multiple LEDs) Multiple light-emitting elements 17 are arranged in a circle, allowing the direction of a dangerous area or a safe area to be indicated by the position of the light emission. For example, by lighting up the LEDs facing north, it can be indicated that the north direction is safe.

[0047] (Modified example 2: Control linked to voice) The light emission pattern of the light-emitting element 17 can be synchronized with the audio output. For example, during the playback of a voice message, the light emission intensity can be changed according to the audio waveform, thereby visualizing the audio.

[0048] (Modified example 3: Integration with ambient light sensor) An ambient light sensor is installed, allowing the light intensity of the light-emitting element 17 to be automatically adjusted according to the ambient brightness. By increasing the light intensity in bright outdoor conditions and decreasing it in dark indoor conditions, visibility can be optimized.

[0049] (Control linked with ambient light sensor) Figure 11 is a flowchart showing the detailed processing of light emission intensity control. In step S301, the ambient light sensor 25 measures and acquires the ambient brightness. In step S302, the light intensity determination unit 36 ​​determines the brightness level. If the brightness is high, the brightness setting is set to high brightness (100%) in step S303; if the brightness is medium, the brightness setting is set to medium brightness (50%) in step S304; and if the brightness is low, the brightness setting is set to low brightness (20%) in step S305. In step S306, the brightness control unit 37 applies the calculated light emission intensity to the light-emitting element 17, and in step S307, it waits for a certain period of time (e.g., 5 seconds) before starting the next measurement.

[0050] Figure 12 is a block diagram illustrating the linked control with the ambient light sensor. The ambient light sensor 25 continuously measures the surrounding lighting environment and transmits the measurement data to the light intensity determination unit 36. The light intensity determination unit 36 ​​analyzes the received brightness data and classifies it into three levels: high brightness (outdoors, sunny), medium brightness (indoors, cloudy), and low brightness (nighttime, darkroom). The classification results are sent to the brightness control unit 37, which calculates the optimal light emission intensity corresponding to each brightness level (high brightness: 100%, medium brightness: 50%, low brightness: 20%). The calculated light emission intensity control signal is transmitted to the control unit 34, which then executes the actual light emission control of the light-emitting element 17. This series of linked controls enables the automatic realization of a highly visible status display adapted to the surrounding environment.

[0051] (Variation 4: Combination with touch sensor) The button section 16 is a touch sensor rather than a physical button, and the position of the light-emitting element 17 can be changed according to the touch position. This allows the light-emitting element 17 to be used as feedback for touch operations.

[0052] (Improvements in computer capabilities) The present invention achieves the following improvements in computer functions. Firstly, since status is displayed without using a display, the overall power consumption of the system can be significantly reduced. The power consumption of LEDs is less than 1 / 10 of that of a display, which greatly contributes to extending battery life.

[0053] Secondly, status indication using light-emitting elements has a lighter processing load compared to display displays. Display displays require complex processing such as screen rendering and UI control, but LED control is simple ON / OFF control or PWM control, which significantly reduces the processing load on the processor.

[0054] Thirdly, notifications using light-emitting elements can be displayed instantly, offering excellent real-time capabilities. While display screens require time for startup and rendering, LED illumination is instantaneous, enabling rapid notification in emergencies.

[0055] (Improvements to the user interface) The present invention achieves the following improvements to the user interface. Firstly, by placing a light-emitting element in the button area, the operation unit and the display unit are integrated, eliminating the need to shift one's gaze. There is no longer a need to check the screen before operating the button, as in conventional systems, enabling intuitive operation.

[0056] Secondly, status indication using light patterns is an intuitive means of information transmission that does not rely on language or text. Because information is expressed through colors and flashing patterns, it can be easily understood even by young children who cannot read. Furthermore, because it is visual information, it is also effective for users with hearing impairments.

[0057] Thirdly, the display method, which is visible from any direction (360 degrees), allows users to check the status regardless of the device's orientation. While a display needs to be viewed from the front, LED illumination is visible from the side as well, resulting in fewer restrictions on use.

[0058] (Business value and scalability) This invention has high business value as a differentiating factor in the monitoring device market. While conventional monitoring devices have struggled to differentiate themselves functionally, this invention allows for a unique user experience. Furthermore, reduced power consumption enables smaller and lighter device designs, lessening the burden on children to carry the device.

[0059] Furthermore, the light emission control technology of the present invention can be applied to various IoT devices other than monitoring terminals. For example, it can be used for status displays in smartwatches, fitness trackers, smart speakers, etc., demonstrating the high versatility of the technology.

[0060] (Details of the technical implementation) The light-emitting element 17 is controlled by PWM (Pulse Width Modulation) control. The control unit 34 controls the light emission color, light emission intensity, and blinking pattern using the duty cycle, frequency, and waveform of the PWM signal. For example, under normal conditions, it blinks gently with a 10% duty cycle, and under emergency conditions, it blinks rapidly with high brightness with a 90% duty cycle.

[0061] When using multi-color LEDs (RGB LEDs) as the light-emitting elements 17, it is possible to express 16.77 million colors by independently controlling each color component (red, green, blue) with PWM. Furthermore, by spacing the light-emitting elements 17 at approximately 2 to 5 mm intervals, a uniform illumination display is achieved while suppressing light interference between adjacent LEDs.

[0062] (Example of performance figures) The power consumption reduction effect of the present invention is shown in specific figures. While conventional displays consume approximately 100-200mW of power, LED displays require only about 1-10mW of power, achieving a power consumption reduction of more than 90%. This makes it possible to extend battery life from the conventional 1 day to 3-5 days.

[0063] In terms of response performance, while the startup time for the display is approximately 100-500ms, the LED lights up in approximately 1-5ms, achieving a response time more than 100 times faster. In terms of visibility distance, the LED light can be seen from a distance of approximately 10-20m even in bright outdoor environments, achieving a 3-4 times improvement in visibility compared to conventional displays (approximately 2-5m).

[0064] (Detailed description of the conceptual hierarchy) Regarding "light-emitting elements," the higher-level concept is light-emitting devices, the intermediate-level concepts include LEDs, organic ELs, inorganic ELs, laser diodes, etc., and the lower-level concepts include monocolor LEDs (red LEDs, blue LEDs, green LEDs, etc.), full-color LEDs (RGB LEDs, RGBW LEDs, etc.), and special LEDs (near-infrared LEDs, ultraviolet LEDs, etc.).

[0065] Regarding "operating state," the higher-level concept is system state, with intermediate concepts such as communication state, processing state, and warning state. The lower-level concepts include communication state (e.g., receiving voice, transmitting data, acquiring location information), processing state (e.g., recording, taking photos, performing calculations), and warning state (e.g., entering a dangerous area, low battery, anomaly detection).

[0066] Regarding "light emission control," the higher-level concept is light emission pattern control, the intermediate-level concepts include light emission timing control, light emission intensity control, and light emission color control, and the lower-level concepts include continuous lighting, blinking (slow, medium, high speed), fading, etc. for light emission timing control, low brightness, medium brightness, high brightness, variable brightness, etc. for light emission intensity control, and monochromatic emission, multicolor emission, gradient emission, etc. for light emission color control.

[0067] (Experimental modification 5: Light emission in conjunction with other devices) The light-emitting elements of the monitored device 10 and the guardian device 20 can be controlled in a coordinated manner. For example, if a child enters a dangerous area, the light-emitting elements of both the monitored device 10 and the guardian device 20 can be synchronized to flash, thereby enhancing emergency notifications to the guardian.

[0068] (Variation 6: Emotional expression through AI collaboration) By integrating with voice recognition AI and image recognition AI, the device can estimate a child's emotional state and reflect it in its light emission pattern. For example, when sending a voice message with a sad voice, it will emit blue light, and when sending a message with a happy voice, it will emit warm light, thus visualizing emotions.

[0069] (Modification example 7: Light emission control with learning function) It can learn the user's behavior patterns and perform personalized light control. For example, by learning the frequency of use at specific times and locations, it can automatically adjust the light intensity and duration, thereby creating a display that is adapted to each individual's usage environment.

[0070] (Variation 8: Group communication support) When group communication is performed between multiple monitored devices, the status of each device in the group can be distinguished and displayed using different light patterns. For example, a message sent by a friend can be displayed in green, and a message sent by a guardian can be displayed in blue, allowing the sender to be identified by the light color.

[0071] (Variation 9: Multiple microphone and speaker configuration) Multiple microphones 19a, 19b and multiple speakers 21a, 21b can be arranged to improve sound quality and expand functionality. In a multi-microphone configuration, beamforming technology can selectively capture sound from a specific direction, suppressing ambient noise. It is also possible to estimate the direction of the sound source by utilizing the positional difference between two microphones. In a multi-speaker configuration, stereo sound reproduction, echo cancellation, and increased volume can be achieved. These acoustic devices are efficiently arranged within the gap 24 in the lower part of the case of the button section 16.

[0072] (Example 10: Diverse applications of cameras) When camera 18 is installed, it can be used for a variety of purposes, including: (1) Communication: photo messages, video messages, video calls, etc.; (2) Monitoring: periodic automatic shooting, automatic shooting in emergencies, activity recording, etc.; (3) Authentication: identity verification by facial recognition, fingerprint authentication assistance, etc.; (4) Information acquisition: 2D code reading, optical character recognition (OCR), object recognition, etc.; (5) Emotion and health management: emotion estimation by facial recognition, health status assessment by facial color analysis, etc.; (6) Safety confirmation: shooting of the surrounding environment, detection of hazardous materials, checking traffic conditions, etc. The camera's placement, resolution, shooting angle, etc. can be optimized according to these applications. Figure 13 shows a modified example of camera placement, and Figure 14 shows an example of screen display for each application.

[0073] (Modification 11: Integration with sound control) The camera 18's shooting status and sound control can be linked. For example, during shooting, the microphone 19's sensitivity can be automatically adjusted to record the shooting sound, allowing it to be sent as a three-dimensional message combining photos and audio. Furthermore, during video calls, the echo cancellation function using multiple microphones can be automatically activated to improve call quality.

[0074] (Technological advantages in improving data processing efficiency) This invention significantly reduces memory usage and CPU processing load by optimizing the light emission control data structure. Conventional display systems require processing pixel information for the entire screen (e.g., 320 x 240 x 24 bits = 1,843,200 bits), but LED light emission control can be controlled with only 16 bits in total: a state identifier (8 bits) and a light emission pattern identifier (8 bits). This reduces memory usage to 1 / 115,000 and significantly improves processing speed.

[0075] Furthermore, the light emission control algorithm employs a state machine to efficiently manage transitions between operating states. Each state is assigned a unique identifier, and the next light emission pattern is determined based on a state transition table, minimizing conditional branching and ensuring real-time performance.

[0076] (Optimization of communication protocols) A new data format is defined for communication between the monitored terminal 10 and the guardian terminal 20, which includes light emission control information. While conventional screen display information takes up several KB to several MB of data, light emission control information only requires a few bytes to tens of bytes, significantly reducing communication bandwidth and lowering communication costs.

[0077] Furthermore, a compression algorithm is applied to the light emission control information, enabling efficient representation of repeating patterns. For example, blinking patterns are represented by a combination of period and waveform, improving data compression.

[0078] (Enhanced security) By applying encryption technology to the light emission pattern, it is possible to prevent unauthorized acquisition of status information by third parties. By embedding an encrypted authentication code within a portion of the light emission pattern, it is possible to configure the system so that accurate status information can only be decrypted using a legitimate parental device.

[0079] (Compliance with international standards) The light emission control technology of the present invention can be applied to international standards for status indication of IoT devices. By defining light emission patterns in accordance with standards such as IEC (International Electrotechnical Commission) and ISO (International Organization for Standardization), international compatibility is ensured, and a technological advantage can be maintained when expanding overseas.

[0080] Furthermore, elements of each embodiment may be combined as appropriate.

[0081] Figure 14 shows variations in camera placement. In Pattern A, camera 18a is positioned at the top front of the housing, making it suitable primarily for capturing children's facial expressions. In Pattern B, camera 18b is positioned on the side of the housing, with a fan-shaped dashed line indicating the range of the surrounding environment. In Pattern C, camera 18c is positioned at the corner of the housing, achieving an intermediate shooting angle between the front and the side. All of these placements are designed to not obstruct the visibility of the light-emitting element 17.

[0082] Figure 15 shows an example of the coordination between the screen display and the LED status display. (A) In normal standby mode, the time is displayed on the display 15 and the light-emitting element 17 is off. (B) In voice reception mode, the display does not change, but the light-emitting element 17 lights up to notify of a new message. (C) In recording mode, the display 15 shows "REC" and the light-emitting element 17 flashes simultaneously. (D) In ​​hazardous area detection mode, a warning appears on the display 15 and the light-emitting element 17 flashes rapidly. In this way, the coordination between the display and LED illumination enables the presentation of multiple pieces of information.

[0083] The placement of the acoustic devices is described below. The microphone 19 and speaker 21 are positioned within a gap 24 formed on the underside of the button section 16. The gap 24 is designed with a width of 0.5 to 2.0 mm to optimize acoustic characteristics. Sound from the speaker 21 is output to the outside through the gap 24, and the microphone 19 picks up external sound through the same gap 24. This configuration enables high-quality acoustic functionality within a limited enclosure space.

[0084] (Relationships between drawings) The drawings in this embodiment have the following hierarchical relationships. Figure 1 shows the overall system configuration, and Figures 2 and 3 detail the hardware and software configurations of the monitored terminal 10, respectively. Figures 4 and 5 show the external configuration in two patterns, basic and extended, and Figures 6 and 7 concretize the arrangement of the light-emitting element 17, which is the core of the invention. Figure 8 defines the specific specifications of light emission control, and Figures 9 and 10 show the main processing flow. Figures 11 and 12 explain the details of the environmental adaptation function, and Figure 13 represents the time-series operation. Figures 14 and 15 show application examples and modifications. These drawings are interrelated and disclose the technical idea of ​​the present invention from multiple perspectives and in detail. In particular, each component shown in the hardware configuration of Figure 2 is implemented in software in the functional block diagram of Figure 3, its physical arrangement is shown in the external configurations of Figures 4 to 7, and its operation specifications are detailed in Figures 8 to 13, creating a consistent structure.

[0085] Conventional monitoring devices have the following technical challenges. Firstly, because they use a display to show the operating status, they consume a lot of power (approximately 100-200mW) and have a short battery life. Secondly, in environments where display use is restricted, such as schools, it becomes difficult to check the operating status.

[0086] Thirdly, conventional general-purpose notifications using a single notification LED cannot distinguish and display multiple different operating states (voice reception, recording, photography, danger warning, etc.). For example, it was impossible to distinguish between an indicator showing that recording was in progress and an indicator showing entry into a danger area, making it difficult to judge the urgency.

[0087] Fourthly, in conventional technology, the user-operated parts (buttons, etc.) and the status display parts (display or notification LED) are physically separated, making it difficult to check the status simultaneously during operation. In particular, for monitoring devices used by children, the integration of operation and status confirmation is important, but this has not been achieved in conventional technology.

[0088] [Note 1] General-purpose tasks One of the objectives of the present invention is to provide an efficient and highly visible user notification method for small electronic devices.

[0089] Issues corresponding to [Appendix 2] One of the objectives of this invention is to solve the problems of high power consumption and limited visibility associated with the use of displays. [Note 2] A monitored terminal comprising: a communication unit for communicating with an external terminal; a display; a button unit for accepting user operations; a light-emitting element arranged in an area of ​​the button unit other than the display area of ​​the display; and a control unit for controlling the emission of the light-emitting element according to the operating state of the device.

[0090] According to one embodiment of the present invention, the operating status can be displayed by light-emitting elements arranged in an area other than the display area of ​​the button, thereby achieving the following technical effects. Firstly, since a display is not required, power consumption can be reduced compared to conventional designs, resulting in power savings.

[0091] Secondly, by combining different light colors and flashing patterns, it becomes possible to distinguish and display multiple operating states, which was not possible with conventional single notification LEDs. For example, intuitive status identification can be achieved, such as a solid blue light indicating voice reception, a flashing red light indicating recording in progress, and a rapidly flashing red light indicating a danger warning.

[0092] Thirdly, because the control unit (buttons) and the display unit (light-emitting element) are integrated, the status can be checked simultaneously during operation without having to shift one's gaze, as is the case with conventional technology. This provides an interface that is particularly easy for children to use.

[0093] Fourthly, the high-speed response of LEDs enables faster status display compared to conventional displays, allowing for quick warning display in emergencies.

[0094] Issues corresponding to [Appendix 3] One of the objectives of this invention is to solve the problem that general-purpose terminals have difficulty addressing the unique challenges of monitoring. [Note 3] The device further comprises a location information acquisition unit, and the device functions as a monitored terminal as described in Note 2. This allows us to provide features specifically designed to ensure the safety of children.

[0095] Issues corresponding to [Appendix 4] One of the objectives of this invention is to solve the problem of difficulty in understanding the state of communication between parents and children. [Note 4] The operating state includes the state of receiving voice messages from an external terminal by the communication unit, as described in Note 2, for the monitored terminal. This enables immediate recognition of message arrival.

[0096] Issues corresponding to [Appendix 5] One of the objectives of this invention is to solve the problem of difficulty in visually confirming the recording status. [Note 5] The monitored terminal as described in Note 2, further comprising a microphone, wherein the operating state includes the state in which recording is being performed by the microphone. This makes it possible to clearly identify the start and end of the recording.

[0097] Issues corresponding to [Appendix 6] One of the objectives of this invention is to solve the problem of the shooting state being difficult to recognize from the surroundings. [Note 6] The monitored terminal as described in Note 2, further comprising a camera, wherein the operating state includes the state in which the camera is taking pictures. This ensures privacy and clarifies the shooting conditions.

[0098] Issues corresponding to [Appendix 7] One of the objectives of this invention is to solve the problem of insufficient emergency notification when entering a hazardous area. [Note 7] The aforementioned operating state includes the state in which entry into a pre-set dangerous area is detected, as described in Note 3, for the monitored terminal. This enables quick and powerful warnings to children.

[0099] Issues corresponding to [Appendix 8] One of the objectives of this invention is to solve the problem that the amount of information that can be obtained from a single light emission pattern is limited. [Note 8] The monitored terminal as described in Note 2, wherein the control unit controls the emission of light from the light-emitting element with different emission patterns depending on the type of operating state. This makes it possible to visually distinguish between various types of state information.

[0100] Issues corresponding to [Appendix 9] One of the objectives of this invention is to solve the problem of the limitations in expressive power of a single light-emitting element. [Note 9] The monitored terminal according to Note 2, wherein a plurality of light-emitting elements are provided, and the control unit controls the position of the plurality of light-emitting elements to be illuminated according to the operating state. This allows for a richer range of expression, including direction and intensity.

[0101] Issues corresponding to [Appendix 10] One of the objectives of this invention is to solve the problem that it is difficult to distinguish between states based solely on the light emission pattern. [Note 10] The monitored terminal as described in Note 2, wherein the control unit controls the light emission color of the light-emitting element according to the type of operating state. This makes it possible to distinguish between states in an intuitive and easy-to-understand way.

[0102] Issues corresponding to [Appendix 11] One of the objectives of this invention is to solve the problem of unclear tactile feedback when using touch sensors. [Note 11] The monitored terminal as described in Note 2, wherein the button portion is configured as a physical button including a movable portion, and the light-emitting element is provided on the movable portion. This results in improved ease of use through the complete integration of the control panel and display panel.

[0103] Issues corresponding to [Appendix 12] One of the objectives of this invention is to solve the problem of limitations in visibility from a specific direction. [Note 12] The light-emitting element is arranged on the outer periphery of the display, and is the monitored terminal as described in Note 2. This enables a status display that can be viewed from 360 degrees.

[0104] Issues corresponding to [Appendix 13] One of the objectives of this invention is to solve the problem of difficulty in visually confirming the communication status. [Note 13] The operating state includes the state in which communication is being performed by the communication unit, as described in Note 2, for the monitored terminal. This makes it possible to monitor the data transmission status.

[0105] Issues corresponding to [Appendix 14] One of the objectives of this invention is to solve the problem of difficulty in providing appropriate warnings about low battery levels. [Note 14] The aforementioned operating state includes the monitored terminal as described in Note 2, including the state of low battery level. This makes it possible to accurately determine the optimal charging timing.

[0106] Issues corresponding to [Appendix 15] One of the objectives of this invention is to solve the problem of insufficient visual representation of urgency. [Note 15] The monitored terminal as described in Note 2, wherein the control unit controls the blinking interval of the light-emitting element according to the urgency of the operating state. This makes it possible to issue appropriate warnings according to the urgency of the situation.

[0107] Issues corresponding to [Appendix 16] One of the objectives of this invention is to solve the problem that it is difficult to achieve optimal display according to the environment with fixed brightness. [Note 16] The monitored terminal according to Note 2, further comprising an ambient light sensor, wherein the control unit controls the light emission intensity of the light-emitting element according to the ambient brightness detected by the ambient light sensor. This ensures optimal visibility in a variety of environments.

[0108] Issues corresponding to [Appendix 17] One of the objectives of this invention is to solve the problem of unclear feedback from button operations. [Note 17] The monitored terminal as described in Note 2, wherein the control unit controls the emission of the light-emitting element in response to the start of pressing the button. This improves usability by integrating operation confirmation and status display.

[0109] [Appendix 18] The corresponding issue (method claim) One of the objectives of the present invention is to provide an efficient method for displaying status. [Note 18] An information processing method performed by a computer, comprising the steps of: determining the operating state of the device; and controlling the emission of light-emitting elements arranged in an area other than the display area of ​​the display according to the operating state. This makes it possible to implement systematic status display processing.

[0110] Issues (program claims) corresponding to [Note 19] One of the objectives of the present invention is to provide a general-purpose implementation method for light emission control functions. [Note 19] A program that causes a computer to perform a process to determine the operating state of the device, and a process to control the emission of light-emitting elements located in areas other than the display area of ​​the display, according to the operating state. This makes it possible to deploy light emission control functions to various devices.

[0111] Issues corresponding to [Appendix 20] (system claims) One of the objectives of this invention is to realize coordinated status displays across the entire monitoring service. [Note 20] An information processing system including a monitored terminal as described in Note 2, and an external terminal that communicates with the monitored terminal. This enables effective status display in comprehensive monitoring services.

[0112] Issues related to [Note 21] (multiple acoustic device configurations) One of the objectives of this invention is to solve the problem of the limitations in sound quality and functionality that exist with a single microphone and speaker. [Note 21] The monitoring terminal as described in Note 2, wherein multiple microphones and speakers are arranged in the gap formed between the button portion and the housing. This enables high-quality sound processing such as beamforming, echo cancellation, and stereo sound.

[0113] Issues related to [Appendix 22] (related to acoustic output path structure) One of the objectives of this invention is to solve the problem of difficulty in ensuring sound quality in small devices. [Note 22] The monitored terminal as described in Note 21, wherein the gap between the housing and the button portion functions as an acoustic output path. This enables efficient acoustic design and quality improvement in limited spaces.

[0114] Issues related to the multi-purpose deployment of cameras, as noted in [Appendix 23]. One of the objectives of this invention is to solve the problem that single-function cameras have limitations in terms of the added value they can provide to monitored devices. [Note 23] The camera is used for creating photo and video messages, monitoring and taking photos, authentication, information acquisition, and sentiment analysis, as described in Note 6 for the monitored terminal. This allows a single camera to provide a variety of monitoring and communication functions.

[0115] Issues related to [Appendix 24] (Sound and imaging coordinated control) One of the objectives of this invention is to solve the problem that individual functions have limitations in providing an integrated user experience. [Note 24] The control unit controls the camera's shooting and the microphone's recording in coordination, as described in Notes 5 and 6 for the monitored terminal. This enables the provision of a rich communication experience through the combination of photos and audio.

[0116] Issues related to [Appendix 25] (related to adaptive acoustic control) One of the objectives of this invention is to solve the problem that fixed acoustic settings make it difficult to accommodate diverse usage environments. [Note 25] The monitored terminal as described in Note 21, wherein the control unit automatically adjusts the sound control of the microphone and speaker according to the usage status such as the shooting state and call state. This enables the automatic realization of optimal sound quality according to usage conditions. [Explanation of Symbols]

[0117] 1. Monitoring System 10. Monitoring device 11 processors 12 memory 13 Storage 14 Communication Interfaces 15 displays 16 Button section 16a Moving part 17 Light-emitting element 17a Light-emitting element (single arrangement) 17b Light-emitting element (top) 17c light-emitting element (right side) 17d Light-emitting element (bottom) 17e Light-emitting element (left side) 18 Cameras 18a Camera (front top position) 18b Camera (side-mounted) 18c camera (corner placement) 19 Mike 19a Mike (1st) 19b Mike (2nd) 20 Parental devices 21 speakers 21a Speaker (1st) 21b Speaker (2nd) 22 GPS receiver 23 bus 24 gaps, inertial sensors 25 Ambient light sensor 26 cabinets 30 Networks 31 Communications Department 32 Location information acquisition unit 33 Detection unit 34 Control Unit 35 Storage section 36 Light intensity determination section 37 Brightness control unit 40 Monitoring Server A Display area B boundary line, battery Area outside the display area of ​​the C display

Claims

1. A communication unit that communicates with external terminals, The display and A button section that accepts user input, A light-emitting element is arranged in the area of ​​the button portion other than the display area of ​​the display, A control unit that controls the light emission of the light-emitting element according to the operating state of the device, A monitoring device carried by the person being monitored, equipped with the necessary features.

2. The monitored terminal according to claim 1, further comprising a location information acquisition unit, wherein the device functions as a monitored terminal.

3. The monitored terminal according to claim 1, wherein the aforementioned operating state includes the state of receiving a voice message from an external terminal by the communication unit.

4. The monitored terminal according to claim 1, further comprising a microphone, wherein the operating state includes the state of recording by the microphone.

5. The monitored terminal according to claim 1, further comprising a camera, wherein the operating state includes the state in which the camera is taking pictures.

6. The monitored terminal according to claim 2, wherein the aforementioned operating state includes a state in which entry into a pre-set dangerous area is detected.

7. The monitored terminal according to claim 1, wherein the control unit controls the emission of light from the light-emitting element with different emission patterns depending on the type of operating state.

8. The monitored terminal according to claim 1, wherein a plurality of the light-emitting elements are provided, and the control unit controls the position of the plurality of light-emitting elements to emit light according to the operating state.

9. The monitored terminal according to claim 1, wherein the control unit controls the light emission color of the light-emitting element according to the type of operating state.

10. The monitoring terminal according to claim 1, wherein the button portion is configured as a physical button including a movable portion, and the light-emitting element is provided on the movable portion.

11. The monitoring terminal according to claim 1, wherein the light-emitting element is arranged on the outer periphery of the display.

12. The monitored terminal according to claim 1, wherein the aforementioned operating state includes the state in which communication is being performed by the communication unit.

13. The monitored terminal according to claim 1, wherein the aforementioned operating state includes a state of low battery level.

14. The monitored terminal according to claim 1, wherein the control unit controls the blinking interval of the light-emitting element according to the urgency of the operating state.

15. The monitored terminal according to claim 1, further comprising an ambient light sensor, wherein the control unit controls the light emission intensity of the light-emitting element according to the ambient brightness detected by the ambient light sensor.

16. The monitored terminal according to claim 1, wherein the control unit controls the emission of light from the light-emitting element in response to the start of pressing the button.

17. An information processing method performed by a computer, comprising the steps of: determining the operating state of the device; and controlling the emission of light-emitting elements arranged in an area other than the display area of ​​the display according to the operating state.

18. A program that causes a computer to perform a process to determine the operating status of the device, and a process to control the emission of light-emitting elements located in areas other than the display area of ​​the display, according to the operating status.

19. An information processing system comprising a monitored terminal as described in claim 1, and an external terminal that communicates with the monitored terminal.

20. The monitoring terminal according to claim 1, wherein a plurality of microphones and speakers are arranged in the gap formed between the button portion and the housing.

Images